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A  PRODUCTION  NETWORK  MODEL  AND  ITS  DIFFUSION  APPROXIMATION 


by 

Michael  Louie  Wenocur 

Abe tract 

This  report  develops  and  analyzes  a  general  stochastic 
model  of  a  production  systea.  The  aodel  if  closely  related  to 
Harrison's  [5]  assembly-like  queueing  network,  the  principal  differ¬ 
ence  being  that  hare  we  assuae  all  storage  buffers  have  finite 
capacity.  Our  attention  is  focused  on  a  vector  stochastic  process  Z 
whose  components  are  the  contents  of  the  various  storage  buffers  (as 
functions  of  tiae).  The  principal  result  is  a  weak  convergence 
theorea  of  the  type  developed  by  Iglehart  and  Whitt  [7]  for  queues  In 
heavy  traffic.  This  llalt  theorea  show*  that,  with  large  buffers  end 
balanced  loading  of  the  system's  work  stations  (see  below),  a  properly 
normalised  version  of  the  storage  process  Z  can  be  well  approximated 
by  a  certain  vector  diffusion  process  Z*.  We  construct  Z*  by 
applying  a  particular  (and  rather  complicated)  reflection  aapplng  to 
multidimensional  Brownian  aotlon.  Various  properties  of  the  Halting 
diffusion  Z*  are  developed,  but  these  provide  only  a  modest  begin¬ 
ning  for  the  analytical  theory  that  aust  be  developed  before  our  limit 
theorea  can  lead  to  practically  useful  approxiaatlon  procedures. 
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CHAPTER  1 


INTRODUCTION  AND  SUMMARY 


This  report  develops  end  analyses  s  general  stochastic 
model  of  a  production  system.  The  nodal  is  closely  related  to 
Harrison's  [5]  assenbly-like  queueing  network,  the  principal  differ¬ 


ence  being  that  bare  we  assune  all  storage  buffers  have  finite 
capacity.  Our  attention  is  focused  on  a  vector  stochastic  process  Z 
whose  components  are  the  contents  of  the  various  storage  buffers  (as 
functions  of  tine).  Tbs  principal  result  is  a  weak  convergence 
theorem  of  the  type  developed  by  Iglehart  and  Whitt  [7]  for  queues  in 
heavy  traffic.  This  Unit  theorem  shows  that,  with  large  buffers  and 
balanced  loading  of  the  system's  work  stations  (see  below),  a  properly 
normalised  version  of  the  storage  process  Z  can  be  well  approximated 
by  a  certain  vector  diffusion  process  Z*.  Wa  construct  Z*  by 
applying  a  particular  (and  rather  complicated)  reflection  napping  to 

multidimensional  Brownian  motion.  Various  properties  of  the  Uniting 

* 

diffusion  Z*  are  developed,  but  these  provide  only  a  modest  begin¬ 


ning  for  the  analytical  theory  that  must  be  developed  before  our  limit 
theorem  can  lead  to  practically  useful  approximation  procedures. 


1.1  The  Systems  Being  Modelled 

A  simple  example  of  ths  systems  under  study  is  the  assembly 
operation  pictured  in  Figure  1.  Input  items  of  types  1  and  2  sre 
generated  by  external  sources  and  deposited  into  similarly  numbered 
storage  buffers.  We  call  these  external  sources  work  stations  1  and 
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2.  AMMbltn  at  work  station  3  than  combine  tha  input  ltana  into 
finiahad  goods  (type  3  ltana).  Lot  us  asstsM  that  exactly  one  itan 
each  of  types  1  and  2  la  required  to  naka  an  itan  of  type  3,  and  type 
3  ltana  depart  tha  system  Immediately  upon  eonplatlon.  Work  at 
station  1  or  2  aust  atop  if  tha  corresponding  storage  buffer  is  full, 
and  work  at  station  3  nust  stop  if  either  of  the  two  storage  buffers 
is  aapty.  In  tha  former  case,  potential  production  from  the  input 
station  is  lost  because  of  what  ws  will  call  blockage.  In  tha  latter 
case,  potential  production  froa  tha  aasaably  station  is  lost  because 
of  starvation. 

In  tha  description  above,  ws  have  talked  in  tarns  of  discrete 
ltana,  but  Figure  1  could  also  represent  a  blending  operation  in  which 
granulated  or  liquid  Ingredients  are  combined  la  fixed  proportions  to 
produce  a  similarly  continuous  output  product.  la  that  case,  one 
would  speak  of  external  sources  delivering  aaterlal  of  types  1  and  2 
which  la  blended  to  produce  output  aaterlal  of  type  3,  and  tha  storage 

buffers  night  be  called  surge  tanka  in  tha  case  of  liquid  flows.  Even 

* 

when  speaking  of  continuous  flow  systeas,  we  will  nonetheless  employ 
the  language  of  work  stations  and  storage  buffers. 

▲  more  coaplex  sort  of  system  is  tha  production  network  pictured 
in  Figure  2.  Here  we  have  external  work  stations  supplying  aatarial 
of  types  1,  ...,  5,  plus  a  succession  of  internal  work  stations  that 
transform  these  inputs  by  stages  into  an  output  aaterlal  of  type  10. 
Work  stations  6,  8  and  10  have  aultlple  Inputs,  so  they  Involve  aoaa 
sort  of  aaseably  or  blending.  Internal  stations  with  a  single  input 
alght  represent  such  transformations  as  tha  stamping  of  blanks  from 


sheet  steal,  or  Cha  cooling  of  hoc  liquid  input  in  a  heat  exchanger. 
Note  that  each  work  station  in  Figure  2,  except  the  last,  deposits 
its  output  aeterlal  into  a  buffer  of  finite  capacity.  The  work 
station,  output  material  and  storage  buffer  are  all  designated  by  the 
sase  number.  Attention  will  be  restricted  here  to  production  networks 
in  which  all  assembly  or  blending  operations  use  Inputs  in  fixed  pro¬ 
portions  .  each  work  station  produces  s  single  type  of  notarial  as 
output,  and  each  type  of  material  (except  the  finished  product)  is 
used  as  input  at  a  single  downstream  station. 

Typically,  the  amount  of  output  that  a  work  station  can  produce 
in  any  given  period  is  stochastically  variable,  due  to  worker  absente¬ 
eism,  mechanical  failures,  quality  variations  in  raw  materials,  and  so 
forth.  It  is  this  stochastic  variability  that  leads  to  non-sero 
.inventory  levels  in  the  storage  buffers  end  to  lost  potential  output 
due  to  blockage  and  starvation.  Our  objective  in  modeling  is  to 
understand  how  system  performance  characteristics,  like  average 
Inventory  levels  and  average  throughput  rates,  depend  on  distribu¬ 
tional  properties  of  the  work  ratss  at  various  stations. 

1.2  Stochastic  Models  Employed 

Our  ultimate  purpose  is  to  propose  a  class  of  diffusion  processes 
as  models  of  production  networks.  It  is  not  sasy  to  see  that  these 
processes  are  appropriate  for  that  task,  or  to  see  the  conditions 
under  which  they  are  appropriate.  Thus,  as  an  aid  to  intuition,  it 
will  be  shown  that  the  diffusion  model  represents  the  limit  of  more 
readily  comprehensible  models  of  conventional  type.  With  regard  to 


A 


the  precise  characteristics  of  the  so-called  conventional  model,  we 
have  quite  a  bit  of  latitude.  The  particular  conventional  model  to  be 
discussed  hare  was  chosen  with  some  very  specific  criteria  in  mind. 

He  will  now  describe  it,  restricting  attention  to  the  simple  assembly 
operation  of  Figure  1  for  simplicity,  snd  will  afterward  discuas  its 
weaknesses  snd  virtues. 

To  model  the  assembly  or  blending  operation  of  Figure  1,  we  take 
as  primitive  three  increasing  processes  gk  ■  (£^(t),  t  ^  0)  satisfy¬ 
ing  gk(0)  ■  0  (k  ■  1,2,3).  Call  gk  the  potential  output 
process  for  work  station  k,  Interpreting  gfc(t)  -  gk(s)  as  the  total 
output  (total  amount  of  material  k)  that  station  k  can  produce  over 
the  time  Interval  [s,t]  if  it  is  able  to  work  without  Interruption 
during  that  period.  If  blockage  (in  the  case  of  input  stations  1  and 
2)  or  starvation  (in  the  caae  of  blending  atation  3)  occurs,  than  the 
actual  output  will  be  leas  (see  below).  Define  X^(t)  =  gk(t)-g^(t) 
for  k  ■  1,2  and  t  0.  Denoting  by  bfc  the  capacity  of  buffer  k 
(0  <  h^  <  •),  we  assume  as  given  initial  contents  Z^(0)  such  that 
0  <  Z^(0)  <  h^  (k  -  1,2).  A  principle  modeling  task  is  to  explain 
how  the  contents  process  Z(t)  ■  (Z^(t),  Zj(t))  is  defined  in  terms 
of  the  primitive  model  elements  for  t  >  0.  If  there  is  no  blockage 
or  starvation  up  to  time  t,  then  we  have  simply 


(1) 


zk(t)  -  zk(0)  ♦  gk(t)  -  g3(t)  -  Zk(0)  +  X^t) 


input  process  underlying  our  eye tea  aodel.  How  can  (1)  be  aodified  to 
account  for  potential  blodtage  of  the  input  stationa  and/or  starvation 
of  the  blending  station?  Let  Yfc  (t)  denote  the  lost  potential 
output  from  station  k  (due  to  blockage  or  starvation)  up  to  tine  t, 
so  that  actual  output  fron  station  k  over  the  Interval  [0 ,t]  Is 
g)t(t)  -  Yfc(t).  Then  the  correct  aodlficatlon  of  (1)  is 

(2)  Zfc(t)  -  Zk(0)  +  (5k(t)  -  *k(t»  -  (?3(t)  -  *3(t)) 

-  Zk(0)  +  X^t)  -  Y^t)  +  Y3(t)  . 

for  k  ■  1,2  and  t  5^  0*  But  now  we  obviously  have  the  problea  of 
defining  Y(t)  =  (Y^t),  Y2(t),  Y3(t>)  precisely  In  teras  of  prialtlve 

aodel  eleasnta. 

Before  going  further,  ws  Introduce  the  critical  final  assunptlon 
that  Ck  la  a  continuous  process  for  each  k  -  1,2,3.  If  Figure  1 
Is  Interpreted  as  a  blending  pent  ion,  then  this  assunptlon  Is  non- 
cont rovers lal,  but  If  it  rep  ssents  an  assenbly  operation  for  aanufac- 
tured  Itens,  the  continuity  assunptlon  constitutes  a  potentially  gross 
approximation  of  reality.  In  the  latter  case,  our  defense  Is  that  we 
only  seek  to  analyse  well  balanced  high  voluae  systeas  (see  Chapter  6) 
with  relatively  large  buffers.  One  aay  then  reasonably  approximate 
the  cuaulatlve  output  fron  a  work  station  by  a  continuous  function  of 
tine,  and  the  content  of  a  buffer  aay  be  viewed  as  an  approxlaately 
continuous  variable.  Be  that  as  It  aay,  with  gfc  assumed  continu¬ 
ous,  It  Is  reasonable  to  require  that 

'V 
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(3) 


Y|(  Is  continuous  snd  Incrossing  with  Yfc(O)  ■  0 


for  osch  k  -  1,2,3.  Then  Z  will  be  e  continuous  process  as  veil  by 
virtue  of  (2).  Finally,  the  intended  aeanlngs  of  Y  and  Z  suggest 
the  key  relations 

(4)  0  <  Zk(t)  <  bfc  for  k  -  1,  2  snd  t  £  0, 

t 

(5)  /  (bfc-Z^B))  dYk(s)  -  0  for  k  -  1,  2  and  t  >  0, 

t 

(6)  /  (ZjCs)  a  Z2(s))  dY3(s)  -  0  for  t  >  0  . 

The  ueenlng  of  (4)  la  deer,  end  (S)  says  that  potential  output  from 
station  k  •  1,2  is  lost  (Y^  increases)  only  when  -  b^.  Equiva¬ 
lently,  potential  output  from  station  k  -  1,2  is  foregone  or 
sacrificed  in  the  elnlra  amounts  necessary  to  uelntein  Z^(t)  <  b^ 
for  t  ^  0.  In  predsely  parallel  fashion,  (6)  says  that  potentid 
output  fro*  the  blending  operation  is  lost  ody  when  one  or  both  of 
the  storage  buffers  is  eupty,  and  together  with  (4)  this  naans  that 
potentid  blending  output  is  sacrificed  in  the  sdnimna  amounts 
necessary  to  Insure  that  Zfc(t)  >  0  for  all  t  J>  0  and  k  -  1,2. 

He  have  thus  far  dodged  the  question  of  how  one  defines  Y 
predsely  In  terns  of  (  end  Z(0),  while  simply  listing  (3) -(6)  as 
necessary  properties.  It  turns  out,  however,  that  these  properties 
uniquely  deteralne  Y.  The  following  is  a  spedd  case  of  a 
representation  theorem  for  generd  networks  (like  that  pictured  in 


Figure  2)  to  be  proved  in  Chapter  4.  Let  S  (for  state  space)  denote 
the  rectangle  (0,bil  x  I 0 ,b2 J • 

(7)  Theorem.  For  each  continuous  X  and  Z(0)  e  S ,  there  exists  a 
unique  T  satisfying  (3)-(6),  where  Z  Is  defined  in  term  of  T  by 
(2). 

There  remains  the  essential  task  of  specifying  the  stochastic 
character  of  our  potential  output  process  £.  A  number  of  different 
assusiptions  will  ultimately  be  considered,  but  let  us  focus  on  the 
following  for  the  sake  of  concreteness.  Assume  that  there  is  given  an 
I ID  sequence  of  positive  random  three-vectors 

C  -  {(^(n),  C2(n)»  C3(n));  n  -  1,2,3...}  . 

He  now  define  £  In  term  of  £  by  means  of 

(8)  £k(u)  5  Cfc(l)  +  Ck<2)  +  ***  +  ck(*)  *  for  n  Z.  1  “8  k  "  1*2,3 
and  by  linearization 

(9)  5k(t)  s  ([t+lj-t)  «k(lt])  +  (t-[tj)  5k([t+ll)  , 

where  [x]  represents  the  greatest  integer  less  than  or  equal  to  x, 
and  k  -  1,2,3.  Interpret  £k(n)  *•  the  total  potential  output  for 


saying  that  £k  Increases  at  a  fixed  rate  during  each  shift  and 
that  this  rate  varies  from  shift  to  shift.  In  other  words,  the  total 
potential  output  of  a  shift  is  randoa  but  it  is  spread  uniformly  over 
the  shift. 

We  now  present  sons  obvious  and  reasonable  objections  to  our 
conventional  model,  with  a  brief  rejoinder  to  each. 

(a)  It  treats  emulative  potential  output  as  a  continuous  function  of 
tine;  this  is  fine  for  continuous  flow  systems  but  not  as  good 
for  discrete  item  manufacturing  systems.  Our  defense  in  the 
latter  case  is  that  we  will  eventually  restrict  attention  to  high 
volume  systems  where  individual  items  are  more  or  less 
insignificant. 

(b)  The  Model's  representation  of  individual  work  stations  through  a 
single  potential  outflow  process  is  certainly  crude.  In  the  case 
of  stations  populated  by  workers,  for  example,  no  formal  distinc¬ 
tion  is  made  between  single-server  and  multi-server  stations  as 
is  common  in  queueing  theory.  These  differences  must  somehow  be 
expressed  entirely  through  the  distributional  properties  of 

gfc.  Again  our  defense  is  that  these  fine-scale  features  of 
work  canter  operations  will  be  more  or  less  insignificant  for  the 
high-volume  systems  of  interest. 

(c)  With  the  specific  distributional  assumption  that  we  have  employed 
above,  the  distribution  of  the  total  potential  work  during  shift 
n+i  is  independent  of  all  that  has  transpired  during  shifts 
1,2,  ...,  n.  If  the  source  of  stochastic  variability  is 
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mechanical  failure,  for  example,  this  means  that  the  probability 
of  a  failure  on  day  Btl  la  unaffected  by  the  amount  of  work  or 
idlenesa  that  a  machine  may  have  experienced.  This  may  be  very 
unrealistic,  but  we  will  be  looking  at  conditions  under  which  the 
amount  of  Idleness  at  any  given  station  is  vanishingly  small,  and 
again  we  argue  that  the  structural  crudeness  of  our  model  is 
relatively  unimportant. 

(d)  Despite  its  simple  appearance,  our  conventional  model  is 
relatively  intractable,  regardless  of  what  distributional 
assumptions  one  makes  about  £ .  If  specialized  to  the  case  of 
two  stations,  for  example,  it  is  considerably  more  difficult  to 
analyse  than  analogous  queueing  models,  like  the  M/G/l  queue 
with  finite  waiting  room. 

This  last  point  does  not  bother  us,  because  we  do  not  want  to 
analyze  the  conventional  model.  For  us  it  is  Just  a  stepping  stone  to 
the  diffusion  limit.  We  could  take  limits  of  more  finely  structured, 
high  fidelity  models,  but  the  same  diffusion  limit  would  eventually  be 
obtained.  The  virtue  of  what  we  are  calling  our  conventional  model  is 
that  it  makes  for  the  simplest  possible  proof  of  the  limit  theorem 
that  is  our  main  product. 

1.3  Results  Obtained 

In  Chapter  6  we  will  consider  a  sequence  of  production  networks 
Indexed  by  n  -  1,  2,  ....  Hare  and  in  Chapter  6,  we  append  a 
superscript  n  to  our  previous  notation  to  indicate  a  quantity  or 
process  associated  with  the  nth  system.  It  is  assumed  that  all  buffer 


•1ms  Increase  with  n,  and  that  n  '  X  (n»)  ■■>  X*  as  n  ♦  •  , 
where  X^(n»)  Is  the  net  potential  Input  process  for  our  nth 
system,  X*  Is  a  vector  Brownian  motion  (with  some  drift  vector  and 
covariance  matrix),  and  “■>  denotes  weak  convergence  In  an  appro¬ 
priate  function  space.  As  our  main  result.  It  will  be  shown  that 

<Z(n\  Y(n>)  — >  (Z*,  Y*)  as  n  ♦  •, 

where  and  Y^  are  normalised  versions  (see  equations  (6.4) 

and  (6.5))  of  the  contents  process  and  lost  potential  output  procesa 
of  our  ntb  system,  Z*  Is  a  certain  vector  diffusion  (reflected 
Brownian  motion),  and  Y*  Is  a  continuous  Increasing  vector  process 
associated  with  Z*. 

In  order  to  aay  more  about  the  diffusion  limit  Z*,  let  us  again 
consider  the  simple  assembly  or  blending  operation  pictured  In  Figure 
1.  The  state  space  for  the  corresponding  diffusion  limit  Z*  Is  a 
rectangle  S  pictured  In  Figure  3.  In  the  Interior  of  S,  Z* 
behaves  like  the  Brownian  motion  X*.  At  the  boundary,  Z*  reflects 
Instantaneously,  the  direction  of  reflection  being  constant  along  each 
boundary  surface  as  pictured  In  Figure  3.  The  meaning  of  this 
boundary  behavior  will  be  explained,  and  the  processes  Z*  and  Y* 
will  be  precisely  defined.  In  Chapter  4. 

As  a  final  task,  we  will  begin  development  In  Chapter  5  of  the 
analytical  theory  associated  with  our  diffusion  limit  Z*.  TO  explain 
the  character  of  this  theory,  let  us  restrict  discussion  here  to  the 
cese  pictured  In  Figure  3,  denoting  by  c  ■  (c*)  and  A  •  (a*j) 
the  drift  vector  and  covariance  matrix  respectively  of  the  underlying 


restrict  current 


Brownian  notion  X*.  Also  for  simplicity,  we 
discussion  to  tbs  existence  end  computation  of  the  steady-state 
distribution  for  Z*,  although  sons  other  analytical  problems  are 
discussed  In  Chapter  S.  Let  us  define  the  (constant  coefficient) 
differential  operators 


t 


(10) 


(11) 


i 


and 


(12) 


> 


Hots  that  L  la  the  elliptic  operator  associated  with  the  underlying 
Brownian  motion  X*,  while  Is  e  directional  derivative  In  the 
direction  of  reflection  associated  with  boundary  surface  in 
Figure  3*  In  Chapter  5  it  will  be  shown  that  Z*  has  a  unique 
stationary  distribution  n,  and  that  n  satisfies  the  stationary 
equation 


3 

(13)  0  -  /  Lf(x)  n(dx)  +  l  f  D.  f(x)  v^(dx) 

S  k-l 

for  all  f  c  C^(8) ,  where  v^,  Vj»  are  certain  boundary  measures 
concentrating  all  their  aass  on  Sj,  Sj,  83,  respectively. 

It  Is  essentially  here  the  story  ends.  We  conjecture  that  (13) 


uniquely  determines  both  n  end  the  boundary  maasures  v^.  Ho 


proof  will  bo  offorod,  nor  do  wo  ouggost  any  practical  schoao  for 


cooputlng  aomnts  of  n  or  othor  Intaroatlng  quant It lea  frow  (13). 


Nonetheless ,  work  la  currently  under  way  on  theae  problem ,  and  there 
la  reason  to  believe  that  they  will  be  resolved  In  the  not-too-dlatant 
future. 
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In  thin  chapter  we  present  soee  conventions  and  results  used 
throughout  this  work.  In  section  three  of  this  chapter  we  prove  a 
probability  result  of  Independent  Interest. 

2.1.  Conventions  and  notations 

Within  each  chapter,  we  will  refer  to  a  numbered  display  by  its 
number.  When  referring  to  a  numbered  display  in  another  chapter,  we 
will  prefix  the  chapter  number  to  the  display  number,  for  example. 
Theorem  4.1  refers  to  the  first  display  of  Chapter  4. 

One  to  typographical  considerations  we  will  not  use  special 
notation  for  vectors  or  vector  functions.  Tor  example.  0  may  mean 
either  the  real  number  0  or  the  vector  (0. *0.  ....  0)  depending  on 
the  context. 

The  symbol  1  will  denote  the  real  numbers.  For  example.  I® 
is  the  space  of  ^dimensional  real  vectors.  The  interval  [0,«O 
will  be  denoted  by  1+  and  1+  will  refer  to  the  W-fold  product  of 

am 

If  a  c  a  then  lal  I  nax{|ajj»  ....  Ja^J).  This  notation 
will  hold  unless  otherwise  specified.  Let  f  •  (f j,  f^,  ....  fQ) 
where  f^:  [0.T]  ♦  K.  Define 

(1)  If I  i  sup  lf(t)l  , 

0  <  t  <  T 

where  the  value  of  T  c  K*  will  be  clear  from  the  context. 


If  X  la  an  arbitrary  apaca  and  f:  X  ♦  ft,  than  If  I  la  daflnad 


(2) 


Iff 


S  Sop  |f(x) I  . 
*  «  X  1  s 


If  X  has  a  topology,  me  doflne  C(X)  as 


(3) 


C(X)  -  {f:  X  ♦  R  such  that  f  la  continuous > 


If  a,b  c  1*  than  a  >  b  Is  daflnad  by 


(4)  a  >  b  If  and  only  if  aB  £  b#  for  n  -  1,  2, 

Ns  dafina  a  >  b  to  naan  a  £  b  and  a  P  b.  If  f  ,g  nap  X  to 

R"  than  f  >  g  naans  that  f(x)  >  g(x)  for  every  x  <  X.  f  >  g 
naans  that  f  >  g  and  f  #  g. 

Tha  symbols  a  and  v  are  used  to  represent  the  lnflaun  and 
supranun  operations  respectively. 

1st  C*  be  tha  space  of  continuous  functions  f*  If.  ♦  R*. 

The  pair  (Q,7)  will  always  denote  a  nsasurabla  space  end  u  a 
generic  alenant  of  Q.  Suppose  X:  Q  ♦  C*. 

(3)  Convention*  X(w)(t)  will  be  denoted  primarily  by  X(t)  and 
occasionally  by  X(t,u). 

Let  ts  Q  ♦  tO ,•]  and  dafina  X(t)  to  ntan 
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(6) 


X(  ■*(<!>),  (It) 
0 


for  t(w)  < 
for  t  ■  • 


X(t)  - 

This  last  conrantlon  la  implicitly  oaod  in  Chaptars  2  and  5. 

2*2.  Sot  Propoaltiona  In  laal  Analyaia 

In  Propoaltiona  7  and  11,  f  and  g  will  danota  contlnuoua 
fonctlona  froa  If  to  L 

(7)  Propoaltlon.  If  f  and  g  ara  Ineroaalng  and  togathar  aatlafy 

(8)  f  >  g  on  [a(t]  , 


(*)  f(o)  -  •(•)  and  f(t)  -  g(t)  >  0  . 

Than  thara  azlata  u  «  [a,t]  auch  that  f  la  lncraaalng  at  a  and 
f(a)  >  g(n). 

Proof.  If  t  la  a  point  of  lncraaaa  for  f  than  u  -  t  aatlaflaa 
onr  hypothaaia.  Othanrlaa  daflna  a  a a 

(10)  a  s  9ap{w  <  [a,t];  f  la  lncraaalng  at  v)  . 

Lit  (10)  lapllaa  that  f(u)  ■  f(t).  Purtharmora ,  a Inca  tha  polnta  of 
lncraaaa  fom  a  doaad  aat,  it  follow  that  f  la  lncraaalng  at  u. 
Finally,  obaarra  that  f(u)-g(u)  ■  f(t)-g(u)  >  f(t)-g(t)  >  0.  Q.B.O. 


(11)  Proposition.  If  g  la  continuous  and  f  Is  defined  by  f(t) 

-  S’Vo  <  s  <  t  g(t>»  th#n 

(12)  f  Is  s  continuous  function, 

and 

(13)  f(t)  -  Sup  g(s),  where  Q  ■  {r  t  [0,tjs  r  Is  rational) 

*  €  Qt 

and 

(14)  If  f  Is  Increasing  at  t  then  f(t)  ■  g(t)  . 

Proof*  Parts  (12)  and  (13)  follow  easily  froa  the  continuity  of  g, 

and  therefore  only  (14)  will  be  proved.  Suppose  that  f  Is 

Increasing  at  t;  then  every  e  >  0  satisfies  f (t+e)  >  f(t-e).  It 

therefore  follows  that 

(15)  f(t+e)  -  Sup  g(s)  . 

s  c  It-e.t+el 

Lins  (15)  and  the  continuity  of  f  and  g  together  lnply  that 
f(t)  -  g(t).  Q.E.D. 

hat  (Q,F)  he  a  nsasurable  space  and  let  (Fg,  t  £  0)  he  a 
filtration  of  F.  Suppose  that  X,  Y:  Q  +  C  and  that  X(t) , 

Y(t)  c  F  .  Define  W(t)  3  SupQ  < 


<  „(X(s)  -  Y(s))+ 


(16)  Proposition.  The  process  W(t)  la  adapted  to  {F*,  t  >  0), 
l.a. ,  W(t)  eft  for  t  2  0. 

Proof.  Elementary  measure  theory  Implies  that  for  s<  t 

(17)  (X(a)  -  Y(a))+  e  ^  „ 

Furthermore,  the  space  of  F» -measurable  functions  Is  closed  under 

the  operation  of  countable  supremum;  hence  lines  (13)  and  (17)  Imply 

% 

that  W(t)  <  Ff.  Q.E.D. 

Let  (U,  JP)  be  a  measurable  space.  Suppose  that  {Px,  x  «  X} 
la  a  set  of  probability  measures  on  (D,F) ,  where  X  Is  a  metric 
space  with  metric  d.  Let  F^(f)  8  f(u)  dPx(u). 

(18)  • Proposition.  Suppose  there  exists  y  c  X  such  that 


(19) 

Then 


11m  sup  |P*(Q)  -  P7(Q) I  -  0  . 
x  ♦  y  Q  c  F  1  1 


(20) 


11m  sup  |F*(f)  -  Py(f)|  •  0  , 
x  ♦  y  f  c  A 


where  A  i  {f  c  F  such  that 


Proof.  Lot  gx,  gy  bo  the  Radon-Nikodyn  do rl votive*  of  PX,  P7 
relotive  to  the  oeoiure  P*  +  P7.  Then  ev*ry  f  <  A  ootiofloo 

(21)  Px(f)  -  P7(f)  -  /  f(u)(g  (u)  -  g  (u))  (Px+Py)(du)  . 

U  7 

Lino  (21)  lapllco  thot 


(22)  |px(f )  -  P^f )  |  <  J  jg^(u)  -  gy(u)  |  (Px4Py)(du) 


<  2  eup^  (P^Q)  -  Py(Q)  |  . 


Lino*  (19)  end  (22)  together  laply  (20). 


QoKoDo 


Let  X(t)  be  drlftleae  Brownian  notion  on  the  real  line. 


(23)  Convention.  Lot  Px  be  the  dletribotion  on  the  peth  spec,  of  X 
corresponding  to  initlel  etete  X(0)  ■  z. 

Let  r  >  0  be  given  end  define  x  by 


(24) 


x  3  inf{e:  jx(s) 


r) 


(25)  Proposition.  Let  x  e  (-r,r)  be  given.  Then  there  exists  a 
density  fx(s,s)  such  that 


(26) 


P*(t  <  t,  X(r) 


s) 


t 

/  *_(■•*)  ds 
0  x 


and  z  -  r,  and 


for  t  >  0 


(27)  fx(s,z)  Is  a  continuous  function  of  x  on  the  Interval  (-r,r). 
Proof.  Consider  the  following  rescaling  of  X: 


(28)  X*(t)  s  X(4r2t)/(2r)  for  t  >  0  . 

Define  the  stopping  ties  T  as  follows: 


(29)  T  s  Inf (s:  |x*(s)  |  -  j>  . 

Lines  (24) ,  (28)  and  (29)  together  lnply  the  Identity 

(30)  (T.  X*(T))  -  (v/(4r2),  X(t)/(2r))  . 

8 y(*»*)  denote  the  density  of  (T,  X*(T))  corresponding  to 
the  Initial  state  X*(0)  ■  y.  Line  (30)  lilies  the  following 
equation 


(31)  £x(».*>  “  8x/2r<,/<Ar2)*  */(2^)>/(^2)  . 
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It  now  suffices  to  show  that  (T,  X*(T))  has  a  density  gx(s,z) 
which  is  continuous  in  x  e  (-1/2,  1/2).  Observe  that  X*  is 
driftless  Brownian  motion  with  X*(0)  *  X(0)/(2r).  Thus  the  symmetry 
of  driftless  Brownian  motion  implies  the  equation 

(32)  g^s,  j)  -  g_x(®»  ~  y>  for  x  €  T*  T*  * 

Therefore  we  need  only  show  that  gx(s,  -1/2)  exists  and  is 
continuous  in  x.  On  page  267  of  Ito  and  McKean  [8]  it  is  shown  that 
gx(s,  -1/2)  exists  and  has  the  following  expansion 

(33)  s  (s ,—  -j)  -  l  n  x  axp(-n2  x2  s/2)  sin(n x(x  +  j))  • 

n-1 

The  tfelerstrass  M-test  shows  that  gx(s,  -1/2)  is  a  continuous 
function  of  x.  Q.E.D. 

Let  r  >  0  and  K  >  1  be  given.  Define  Bp  as  follows 

(34)  Br  =  (x  «  Rk;  Ixl  -  r)  . 

Define  a  subset  of  Bp  by 

(35)  5  (x  «  Bf;  x^  -  Jr},  where  k  -  1,  ... ,  K,  and  J  -  -1,1 
We  now  define  a  measure  X  on  Bp  by 


1 


1  K 

(36)  \(A)  -  l  If  IA(xlt  . Xj,)  dXj 

j-i  lt-1 

•**  'Vl  dxfcfl  —  ^  • 

In  other  words,  \  Is  the  measure  which  gives  (K-l) -dimensional 
Lebesgue  measure  to  each  face  of  BT. 

Let  W(t)  be  standard  K-dimensional  Brownian  motion.  Define 
the  optional  time  x  by 

(37)  x  =  inf{s:  W(s)  e  Br)  . 

(38)  Proposition.  Let  Ixl  <  r  be  given.  Then  there  exists  a 
density  h^s, x)  such  that 

(39)  PX((t,W(t))  e  Q)  -  /  h  (s ,z)  d\(z)  x  ds  , 

Q 

where  Q  is  a  measurable  subset  of  [0,«O  x  Br,  and 

(40)  11m  h  (s,z)  ■*  hn(8,z)  for  all  s  >  0  and  z  e  B 

«  .  a  *  y  r 


Proof.  Observe  that  if  we  define  x.  .  by 

*  •  J 


(41)  j  s  wk(«)  "  toT  k  . K  J  ■  -1*1 

and 

1 

(42)  tjj  s  a  Tjj  j  for  k  ■  1,  2,  . ..,  K, 

3  * 
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then 


IK  K 

(43)  x  -  a  A  ‘'I,  i  "  A  Tk  * 
j— 1  k-1  k-1 


Since  the  j  are  Independent  continuous  random  variables.  It 
follows  that 


1  K 

(44)  Px((t,  W(«0)  e  Q)  -  l  l  ?*([*,  W(*c))  e  Ql  n  [x  -  x.  .1) 

j— 1  k-i  K»J 

1  K  « 

-  I  l  P  ((*c,  W(t))  €  Q.  , )  , 

j— 1  k-1 

where  j  =  Q  n  [0,-)  x  ^ 


It  thus  suffices  to  show  that  we  can  define  a  density  h^s  ,z) 
which  satisfies  (40)  and 


(45) 


F*((t,  W(t))  €  ) 


/  h  (s,a)  d\(s)  x  ds  . 

Vj 


Due  to  complete  symmetry  we  can  restrict  oar  attention  to  Ri(i«  * 
need  the  following  result  from  Feller  [4].  Define  Qt(u,z)  as 


•  (2iO"1/2  l  {*xp(-  ^I~U^°r>  ') 


Then 

(47)  P*(Wk(t)  c  A,  t.  >  t)  -  /  Q  (x^v)  dv  * 


where  A  Is  a  neasurable  subset  of  (-r,r)  .  Lines  (43)  end  (47) 


together  inply  that 

(48)  Px((-c,  W(t))  €  Qj  j) 

•  /  fx  (•.*!)  Qa(x2,*2)  •••  Qg(*K.*K)  X.(ds)  x  da 

Ql,l  1 

Observe  that  hgCs ,z)  can  be  defined  by 


K  K 


The  density  h^s.z)  then  satisfies  (45).  Since  Qt(ztz)  and 
fz(s,z)  are  continuous  at  x  ■  0,  so  aust  be  hx(u, z).  Q.B.D. 

Let  X(t)  =  W(t)  +  ct  and  define  x  =  lnf{s:  IX(s)l  -  r). 

(50)  Proposition.  Let  Ixl  <  r  be  given.  Then  there  exists  a 
density  h*(s,z)  such  that 

(51)  PX((t,  X(t))  «  Q)  -  /  h*(a,s)  d\(z)  x  ds  , 

Q 

and 

(52)  11a  h*(s,z)  ♦  hi(s,z)  for  s  >  0  and  z  e  B  . 

x  ♦  0  x  u  ”  r 

Proof.  Observe  that  x  is  a  finite  stopping  tine  for  all  x  such 
that  Ixl  <  r.  Consequently  the  Wald  likelihood  ratio  argument 
lapliea 
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(53)  P*«t,  x(t))  «  Q)  •  /  exp{-  (4  c'ce  -  c's)}  h  (s,*)  dX(s)  *  da 

A  *  * 


Therefore 


h*(e,*) 


-  exp{-  (-y  c'ca  -  c's)}  h  (s.a)  . 


Condition  (52)  is  now  obvious  froa  the  last  equation.  Q.E.D. 


2.3  An  Ergodic  Theorem  for  Feller  Processes 

Let  (Q.F)  be  a  measurable  space  and  let  (Fj.;  t  ^  0}  be  a 
right  continuous  filtration  of  F.  Suppose  that  S  is  a  compact 
metric  space  and  that  X  ■  {X(t)»  t  >  0)  is  a  stochastic  process  from 
Q  to  S  which  is  adapted  to  (Fg,  t^  0)/Borel  (S).  Furthermore, 
suppose  that  the  family  {P*,  x  e  S)  makes  X  into  a  Markov 
process,  i.e. .  every  A.  «  Borel  (S)  satisfies 

(54)  F*(X(t+a)  e  a|f^)  -  PX(t)(X(s)  e  A)  a.s.  P*  . 

The  following  definition  was  derived  froa  properties  of  Brownian 
motion. 

(55)  Definition.  A  state  x  e  S  is  diffuelon-llke  for  X  if  there 
exlats  a  neighborhood  base  B  of  closed  sets  such  that  every  B  cl 
satisfies  conditions  (56)  and  (57): 

(56)  Py(v  <  •)  ■  1  for  y  e  B. 
where  x  s  inf(s;  X(s)  e  SB). 
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(57)  lla  sup  Ip7((x,  X(x))  c  A)  -  P*((t,  Kx))  e  A)  I  -  0  . 
y  •¥  x  A  e  A 

whtri  A  la  tha  Boral  subsats  of  tha  product  topology  on  K+  x  &B 
lnducad  by  tha  usual  topology  on  R+  and  tha  ralatlvlcatlon  of  tha 
topology  on  S  to  8B. 

(58)  Baaark.  Supposa  that  tha  following  conditions  ara  aat: 


Py((r,  X(t))  cA)  -  /  p  (t,s)  A(dt  x  ds)  for  y  naar  x  , 

A  7 

and 

lla  p  (t,s)  »  p  (t,s)  a.s.  X  . 

y  ♦  *  7 


Than  Scheffd's  Ta—  (saa  Schaffd  [13])  lapliaa  that  (57)  will  ha 
satlsflad. 


(59)  Thaoraa.  Let  X  ha  as  dascrlbad  above.  In  addition,  supposa 
that  X  Is  a  Fallar  process  such  (for  a  definition  of  Feller  process 
saa  Brelaan  [2])  such  that 

(60)  For  every  non-eapty  open  sat  A  there  exists  t  >  0  such 
that  Pz(X(t)  c  A)  >  0  for  every  x  e  S, 

(61)  lla  Ey(f(X(s)))  ■  Kz(f(X(t)))  whenever  f  e  C(S)  , 

7  *  * 
s  ♦  t 

and 

(62)  Tha  dlf f uslon-llka  points  of  X  are  danse  In  S. 

Than  X  Is  an  ergodlc  process. 
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The  rest  of  this  ■action  is  devoted  to  proving  Theorea  59 


(63)  Proposition*  Let  X  be  •  Feller  process  on  S  such  that 

(64)  For  every  asesureble  set  A  with  non-cep ty  interior  iP 
there  exists  u  >  0  such  that  Px(X(u)  e  A)  >  0  for  every 
x  c  S. 

Then  for  every  such  A  there  exists  a  <  1  such  that 

(65)  P*(t  >  t)  <  for  t  £  2u  and  x  c  S  , 

where  x  =  inf (a:  X(s)  e  A}. 

Proof.  Let  u  satisfy  (64)  for  A0,  and  let  f(x)  »  P*(X(u)  e  A0). 
Since  X  is  a  Feller  process  and  iP  open  it  follows  that 

(66)  MS  f<y>  "  MS  **(*(»>  e  A0)  >  P*(X(u)  <  A0)  -  f(x)  . 

7  ♦  *  y  ♦  X 

Therefore  f  is  lower  seal-continuous  on  S.  Since  S  is  coapact,  f 
achieves  its  ainiaua  at  Xq  c  S.  Thus  infxgS  f(*)  •  f(Xg)  =  1-p  >  0. 

Let  t  ^  2u  be  given.  Set  n  =  [t/(2u)]/2.  Using  an  obvious 
induction  observe  that 
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(67)  PX(t  >  t)  <  PX(X(u)  c  AC,  ...»  X(2nu)  e  AC) 

-  ^[i  (XU^P^dGO  «  AC,  ...»  X((2n-l)u)  e  AC)] 

<  E^I  (X(u))  p2^1]  <  p2n  <  a1  , 

AC 

where  a  •  pl/(2u)#  Q.E.D. 


(68)  Proposition*  Let  X  be  e  Feller  process  on  S  which  satisfies 
(61)  and  1st  D  he  a  closed  subset  of  S.  Suppose  x  is  a 
diffusion-like  point  and  that  x  c  D®.  Then  the  function  Pt(y,D) 
s  p7(X(t)  e  D)  is  continuous  at  x  uniformly  in  t,  l.e. ,  for  e  >  0 
there  exists  a  dosed  neighborhood  F  of  x  such  that 


•®P  *»p  IP^x^D)  -  P  (x-,D)|  < 

t  >  0  xlfx2  e  F  1  t  1  2  1 


Proof.  Since  x  is  diffusion-like,  x  has  a  closed  neighborhood  B 
disjoint  from  D  that  satisfies  (56)  snd  (57).  Define  t  =  lnf{s: 
X(s)  €  8B).  Since  X  has  continuous  paths  and  &B  is  dosed,  it 
follows  that  x  is  a  stopping  time.  Furthermore,  pathwlse  continuity 
implies 

(70)  pt(y»D)  "  **<*(*>  e  D,  t  <  t)  for  y  c  B  . 

Apply  the  strong  Markov  property  to  (70)  to  obtain 

(71)  Pt(y,D)  -  B7(Pt^(X(T),  D))  . 
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Condition  (61)  and  tha  fact  that  D  la  doaad  together  Imply  that 
Pt(?>D)  *■  uPP*r  aenl-contlnuoue  In  (t,y)  and  thus  measurable. 

Furthermore  Supt  |Pt(y,D) |  <:  1  .  Tharafora  Propoaltlon  (18)  can  ba 
applied  to  (71)  to  obtain  (69). 

(72)  Propoaltlon.  Let  X  aatlsfy  tha  condition*  of  Theorem  (59). 
Than  every  doaad  aubaat  D  aatiafiaa 

(73)  lim  aup  |Pt(Xj,D)  -  Pt(x2,D)|  ■  0  . 

t  ♦  •  *1*^2^  ® 

Proof.  For  D  ■  S  tha  propoaltlon  la  trivial,  ao  aupposa  Dc  la  a 

non-empty  aubaat  of  S.  Condition  (62)  implies  that  there  exists 

x  e  Dc  which  la  dlffualon-llka.  Let  e  >  0  ba  given.  Propoaltlon 

(68)  lmpllaa  that  there  exlata  F,  a  doaad  neighborhood  of  x,  which 

aatiafiaa  (69).  Let  x^  .x^  e  S,  and  let  X1  .X2  be  Independent  ver- 

1  2 

alone  of  X  each  that  X  (0)  ■  Xj  and  X  (0)  ■  x2.  Define  T  as 
follows: 

(74)  T  s  inf (a:  (X1(a),  X2(*))  e  F  x  F>  . 

Observe  that 

(75)  Pt(Xj,D)  -  P(XX(t)  e  D,  T  >  t)  +  P(XX(t)  «  D,  T  <  t)  , 
and 

(76)  Pt(x2,D)  -  P(X2(t)  «  D,  T  >  t)  +  P(X2(t)  e  D,  T  <  t)  . 
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IC  is  sasy  to  verify  that  the  coupled  process  (X* ,X^)  satisfies 
the  conditions  of  Proposition  63,  and  therefore  there  exists  an  a  <  1 
such  that 

(77)  sup  P(T  >  t)  a*  ,  for  t  £  2u  . 

»*2  «  s 

Lines  (75),  (76),  and  (77)  together  laply 

(78)  |Pt(xlfD)  -  Pt(x2,D)| 

<  |P(X1(t)  €  D,  T  <  t)  -  P(X2(t)  c  D,  T  <  t) |  +  a  . 

Since  T  is  a  Markov  ties  it  folloes  that 

(79)  P(X*(t)  c  D,  T  <  t)  -  E(I{T  <  t>  P(Xl(t)  e  D |ft) ] 

(where  ?T  3  o((X1(s) ,X2(s)),  0  <  s  <  T)) 
-  *U{T  <  t}  Pt_T(X1(T),  D)]  . 

It  slallarly  follows  that 

(80)  P(X2(t)  «  D,  T  <  t)  -  E[I{T  <  t}  Pt-T(X2(T),  D)]  . 

Line  (69)  now  lnplles  that 
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(81) 


F(XZ(t)  e  D,  T  <  t)  -  P(X*(t)  eD,  T  <  t) | 

<  «I{T<t}  |Pt-T<x2(T)»  D)  "  Wll(T>.  D>P 


<  el  <  e  • 


Therefore  It  follows  froa  (78)  and  (81)  that 


|Pt(xl»D>  "  pt(x2»D)|  <  e  +  «* 


Vx2  C  8 


Slnca  e  la  arbitrary,  aquation  (73)  follows  easily  f row  (82)* 

(83)  Proposition.  Let  Pt(x, •)  be  a  Marker  kernel  on  a  coapact 

aatrlc  space  8.  Suppose  Pt(x,«)  satisfies  (73).  Then  there 

exist  {tn,  n  ^  1}  such  that  ta  ♦  •  and  a  probability  aeasure 

d  on  8  which  together  satisfy 


(84)  Ua  sup  Ip  (x,f)  -  n(f )  I  -  0 
n  ♦  •  x  e  8  1  n  ' 


for  f  e  C(S) 


Proof.  Fix  y  c  8.  Since  8  la  coapact,  the  family  of  aeasures 
{Pt<y.O.  t  >  0}  Is  tight.  Therefore,  there  exist  (tn,  n  £  1) 
and  a  probability  naasure  n  which  together  satisfy 


P*  (y.O  — >  n(-) 


as  n  •  , 


Let  f  £  C(S)  auch  that  0  <  f  <  1.  Lina  (85)  lapllaa  that 

(87)  Pt  (y,f)  ♦  n(f)  aa  n  ♦  -  . 

Q 

Lat  i  ba  an  arbitrary  lntagar.  Sat  Dfc  5  {x;  k-1  <  w£(x)  <  k}, 
and 


■ 

(88)  fs  l  k/a  I-  . 

"  k-1  “k 

Llnaa  (73),  (85)  and  (86)  togathar  iaply  that  thara  axlata  oq  auch 
that 

a  , 

(89)  aup  v  Ip  (x,  DL  )  -  P  (y,  BL  )|  <  l/u  tor  n  >  il.  , 

x  <  S  k-1  1  n  *  cn  *  1  u 

and 

(90)  |Pt  (y,f)  -  n(£) j  <  l/u  for  n  >  Uq  , 

It 

Tharafora,  tha  trlangla  Inequality  lapllaa 

(91)  |Pt  (x,f)  -  n(£) |  <  |Pt  (x,f  -  fB)|  +  |Pt  (x,fB)  -  Pt  (y,£.)| 

n  n  n  n 

+  |Pt  (J'*m  -  « |  +  |Pt  (J* *)  -  n(f)  | 

n  n 

<  l/u  +  u/m2  +  l/m  +  1/n  -  4/n  for  n  n 

Tha  arbltrarlnaaa  of  a  lapllaa  (84)  for  f  e  C(S)  auch  that 
0  <  f  <  1*  Tha  general  caae  now  follow*  aaaily  froa  tha  coapactneaa 


(92)  Proportion.  Let  X  be  *  Markov  process  on  a  coupact  Metric 
space  S.  Suppose  X  satisfies  (60),  (61),  and  (84).  Then  X  is  an 
ergodic  process. 

Proof.  Me  need  to  show  that 

(93)  11m  P  (x,f)  »  n(f)  for  x  e  S  and  f  e  C(S)  , 

t  • 

and 

(94)  n(f)  >0  for  f  e  C(S)  and  f  >  0  . 

Let  f  e  C(S)  and  let  e  >  0  be  given.  Condition  (84)  Implies  that 
there  exists  s  such  that 

(95)  sup  I?  (x,f)  -  n(f)|  <  e  . 

x  e  S  1  *  ' 

Let  t  >  s  be  given.  Then  every  y  e  S  satisfies 

(96)  |Pt(y,f)  -  n(f)|  <  /  Pt_s(y»  dx>  |V**f)  "  n(f)| 

s 

<  !  *t__(y,  dx)c  -  e  . 

S 

Therefore  equation  (93)  aust  hold. 

Finally,  suppose  f  «  C(S)  and  f  >  0.  Observe  that  condition 
(61)  lnplles  that  Pt(*,f)  e  C(S).  Therefore  (93)  lMplles 

(97)  x(f)  -  11m  P^M.(x,f) 

-  11m  /  P  (x,dy)  Pt(y,f)  -  /  II(dy)  P,.(y,f)  . 
s  ♦  •  S  *  S  c 

Lines  (60)  and  (97)  together  Inply  (94).  Q.E.D. 
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Theorca  59  can  thus  be  proved  by  applying  In  sequence  Propositons 
72,  83  and  92. 

2.4  Weak  Convergence  In  Function  Space 

Let  (Q,JB ,P)  be  a  probability  space.  Let  (M,d)  be  a  aetrlc 
space  and  let  ¥  be  the  Borel  sets  of  M. 

(98)  Definition.  Let  X  be  a  napping  fron  Q  to  M  such  that 
X~1(_F)  e  b.  Then  we  say  that  X  Is  an  M-valued  randon  variable  on 
Q. 

(99)  Remark.  He  denote  the  above  relationship  by  either  X  e  B/F  or 
Xc  1.  He  use  the  latter  notation  only  If  F  Is  clear  from  the 
context. 

(100)  Definition.  Let  (Xn,  n  ^  1}  be  a  sequence  of  M-valued 
randon  variables  defined  on  Q.  Suppose  that  every  closed  subset  D 
of  M  satisfies 


(101)  lln  P(X„  c  D)  <  P(X  e  D)  , 

n  ♦  • 

for  sone  M-valued  randon  variable  Xa.  He  then  say  that  {XQ,  n  ^  1} 
converges  weakly  to  I*.  He  denote  this  by 

(102)  X ,  —  >  X  as  n  ♦  • 

n  • 
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Consider  the  partlculer  case  where  M  ■  CN,  d  is  the  metric 
given  in  Whitt  [14],  and  t  is  the  o-fleld  of  Borel  sets  on  CN. 
For  T  >  0  define  rT:  >  CN[0,TJ  as  follows 

(103)  rT(x)(s)  “  x(s)  for  x  e  CN  and  s  e  10,T]  . 

(104)  Lena.  Let  (Xq,  n  1)  be  C**-valued  random  variables. 
Then  {Xq,  n  ^  1}  converges  weakly  to  X*,  if  and  only  if  for 
every  T  >  0  the  sequence  {r^X^,  n  >  1}  converges  weakly  to 
rT(X»). 

For  a  proof  of  Leasu  104,  see  Whitt  [14]. 


CHAPTKK  3 


psoDOcnos  uiwiuls 


In  this  chapter  we  define  precisely  our  general  production 
network  models,  examples  of  which  were  discussed  in  Chapter  1.  In  the 
first  section  we  describe  the  deterministic  features  of  such  systems. 
In  Sections  2  and  3  we  propose  two  different  ways  of  modelling  the 
stochastic  structure  of  a  production  network. 

3.1  The  General  Model 

He  begin  our  description  of  the  general  production  system  by 
specifying  its  network  structure.  The  network  consists  of  K+l 
stations  Indexed  by  the  set  k  ■  1,  2,  ...»  K+l.  Stations  1.  2,  ...,L 
(I*  <  K)  *re  called  external  stations.  We  specify  the  system's  flow 
structure  by  a  map  a :  {1,  2,  ...,  K>  {L+l,  ...,  K+l}.  Interpret 
o(k)  as  the  successor  station  at  which  output  from  station  k  is  used 
as  input.  Thus 

(1)  n<k)  =  <j  e  {1,  ...,  K};  o(j)  -  k) 

is  the  set  of  predecessors  whose  output  is  used  directly  as  input  at 
station  k  (k  •  1+1 ,  ...»  K+l). 

It  is  assumed  that  o(k)  >  k,  and  a  maps  {1,  2,  . ..,  K}  onto 
{1+1 ,  • • • ,  K+l}.  These  two  conditions  guarantee  that  our  network  will 
be  an  arborescent  structure  whose  terminal  station  is  K+l.  Thus 
Inputs  from  the  external  stations  <1,  2,  ... ,  L}  are  combined  by 
stages  into  Inputs  for  the  terminal  station  K+l. 
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It  Is  assuaed  that  for  each  station  k  (k  <  K+l)  there  exists  a 


finite  output  buffer  of  size  bfc.  Furtheraore,  we  associate  a 
potential  output  process  gfe  -  (gj.(t) ,  t  >  0)  with  each  station 
k.  The  process  g^  Is  assuaed  to  be  continuous  and  Increasing  with 
5^(0)  -  0.  Interpret  g^Ct)  as  the  total  production  of  station 
k  through  tlae  t,  providing  that  station  k  works  without 
lapedlaent  during  the  tlae  Interval  [0,t] .  He  now  define  the  net 
potential  Input  process 


(2)  ^(t)  5  CfcCO  “  for  t  >  0  and  k  -  1,  2,  ...»  K. 

Interpret  Xfc(t)  as  the  potential  change  In  the  kth  buffer's 
Inventory  froa  tlae  0  to  tlae  t.  Thus,  if  we  let  Zk(t)  denote 
the  kth  buffer's  actual  Inventory  at  tlae  t,  then  we  have 

(3)  Z^Ct)  -  Z^O)  +  ^(t)  ,  t  >  0  , 

providing  that  neither  station  k  nor  station  o(k)  is  lapeded 
during  the  lnteral  10, tj.  He  need  to  aodify  equation  (3)  'so  that  It 
la  unconditionally  valid.  Thus  we  now  Introduce  the  lost  potential 
output  process  Y^(t).  The  process  T^(t)  should  be  construed  as  the 
aaount  of  potential  output  station  k  loses  due  to  either  starvation 
or  blockage  during  [0,t] .  He  can  now  express  the  actual  output 
process  for  station  k  by  the  difference  g^(t)  -  T^(t).  Therefore, 
the  actual  Input  process  to  buffer  k  Is  given  by  the  expression 
5k(t)  "  "  ^a(k)^  "  ^(k)^^*  lhl*  slaplifies  to 
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V*>  -  yt>  +  ia(k)  (c).  Thus  tbs  proper  generalisation  of  equation 

(3)  is 

(4)  Z^t)  =  Z^CO)  +  X^t)  -  ^(t)  +  Y^U)  ,  t  >  0  and  k  <  X. 

He  denote  by  Z  and  Y  the  vector  processes  (Zj ,  Z2,  ...»  Z^)  and 
(Yj ,  Yj,  . Yr+1)  respectively.  Of  course  the  issue  of  how  to 
define  Y  precisely  has  again  been  skirted.  We  begin  with  the 
reasonable  requirement  that 

(5)  Yfc  is  continuous  and  Increasing,  with  Y^(0)  -  0  for  all  k  . 

Furthermore,  the  intended  meanings  of  Y  and  Z  suggest  that  they 
jointly  satisfy 

(6)  0  <  Zfc(t)  <1^  for  k  -  1,  2 . K  and  all  t  >  0. 

t 

(7)  /  n>k7Zk(s)l  *Yk(s)  -  0  for  k  -  l,  ...»  L  and  all  t  >  0. 

t 

(8)  /  [(b.  -  Z.  (a))  a  Z.(s)]  dY.  (s)  -  0  for  k  -  Lfl . K 

0  K  *  J«n<k)  3  *  and  all  t  >  0, 

t 

(9)  /  [  a  Z.(s)]  dY_. ,(s)  -  0  for  all  t  >  0. 

o  jcn(K+i)  3 

What  we  will  now  see  is  that  (5)-(9)  can  actually  be  used  to  define  Y 
and  Z  in  terns  of  X  and  Z(0)  in  precise  mathematical  terms,  thus 


40 


couple ting  the  specification  of  the  model's  (non-probabilistic) 
structure.  The  following  representation  theorem  will  be  proved  in 
Chapter  4.  Here  and  later  we  denote  by  S  the  state  apace  of  the 
contents  process  Z: 

(10)  S  =  [O.bj]  x  ...  x  [0,bR]  =  [0,b]  . 

(11)  Theorem.  Given  X  continuous  with  X(0)  “  0  and  Z(0)  c  S, 
there  exists  a  unique  Y  satisfying  (5)-(9)  with  Z  defined  in  terms 
of  Y  by  (4). 

To  complete  our  model  specification,  we  need  to  Impose  distribu¬ 
tional  assumptions  on  the  vector  process  £.  Possible  distributions 
for  £  are  presented  in  detail  In  the  next  two  sections  of  this 
chapter. 

3.2  A  Random  Walk  Model 

One  way  to  generate  the  process  £  is  to  construct  it  from  a 
sequence  of  IID  random  vectors  {£(n) ,  n  •>  1 }  by  summation  and  linear 
interpolation.  That  is,  define  gfc  at  integer  times  m  by  the 
equation 

(12)  £k(m)  =  l  Ck(n)  , 

n-1 

and  define  £fc  at  non-integer  times  t  by  linear  interpolation, 
namely 
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(13) 


ck(t)  -  (It+lJ-t)  CkUtJ)  +  (t-(tj)  ck([t+ll)  . 

Hare  [z]  denotes  Che  greatest  Integer  lasa  than  or  equal  to  z. 

As  was  asntloned  in  Section  1.2,  one  can  interpret  Ck(n)  as 
the  total  potential  output  of  station  k  during  the  nth  shift. 
Furthermore  (13)  as y  be  viewed  as  saying  that  work  procaeda  at  the 
fized  rata  of  Ck(n)  units  par  shift.  Finally,  note  that  tha 
components  of  the  random  vector  C  need  not  be  an  Independent  set. 
However,  we  will  assume  In  Chapter  6  that  (C(n),  a  1)  generates  an 
X  process  which  Is  fully  K-dlmenslonal. 

It  la  of  Interest  to  note  that  If  K  ■  1,  then  this  model 
repreaents  an  eztension  of  tha  classical  dlscrete-*tlme  dam  model  to 
contlnuoua  time.  A  good  reference  for  the  dam  problem  Is  Horan  [ 10] . 

3.3  A  Eandom  Environment  Model 

It  Is  useful  to  conceive  of  the  random  rate  vector  C(n)  as 
being  determined  by  the  "working  environment"  of  the  nth  shift.  This 
working  environment  concept  allows  us  to  generalise  the  model  of 
Section  2  In  the  following  way.  Suppose  that  each  working  environment 
persists  for  a  random  period  of  time  and  that  work  proceeds  at  a  fized 
rate  for  the  duration  of  each  working  environment.  Furthermore  we 
will  allow  for  working  environments  to  influence  one  another.  There 
are  many  Interesting  ways  to  Implement  this  model.  For  one  specific 
alternative,  consider  the  following  model.  Let  9  ■  (9(t),  t  0)  be 
a  continuous-time  stationary  Markov  chain  with  states  1,  2,  ...,  M. 


L®t  r(l),  r(2), 
define 


r(M)  be  positive  K+l  dimensional  vectors,  end 


t 

(14)  £.(t)  =  /  r,(0(s))ds  ,  for  k  -  1,  ....  K+l  end  t  ^  0. 

k  o  K 

Equetlon  (14)  may  be  interpreted  es  saying  that  e(s)  is  the 
state  of  working  environment  at  time  s,  and  that  the  kth  station 
works  at  rate  r^CeCe))  at  time  s.  Since  0  is  a  stationary, 
finite  state  Markov  chain,  it  is  possible  to  recursively  define  the 
transition  times  to  the  successively  visited  states.  That  is,  define 
Tq  =  0  and  Tq  recursively  by 

(15)  Tn  5  inf {s  >  0(s)  *  ©(T^j)}  ,  for  n>l  . 

Now  define  the  nth  holding  time  Tn  by 

<»*>'  *«*  *■«-*.•  £.r  n>0  . 

Furthermore,  there  exist  strictly  positive  constants  \(m),  1  <  m  <  M, 
and  an  M  x  M  transition  matrix  Q  which  jointly  satisfy 


(17)  p(0(Tttfi>  -  j,  vn  >  t|0(Tn)  -  i)  -  e"X(1)t 

for  t  >  0  and  i,j  c  (1,  2,  ...,  M), 


and 
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CHAPTER  4 

THE  IEPLECTIOH  MAPPHG 

We  Cake  aa  given  Integers  K  £  L  1,  and  a  nap  o:  {1,2,...,K> 

♦  {Id-1 . K+l }  such  that  o(k)  >  k  and  a  naps  {1,  2,  ...»  K> 

onto  {Id-1,  ...»  K+l}.  Alao  taken  a8  primitive  is  a  vector  b  »  (bp 
. . . ,  bg)  with  bg  >  0  for  all  k.  Let  be  the  space  of 
continuous  functions  x:  (0,®)  RK,  endowed  with  the  topology  of 
unlfona  convergence,  on  conpact  intervals.  Conponent  functions  are 
denoted  xj(t)  for  t  0  and  j  ■  1,  2,  ....  K.  Let  Cg  be 
the  set  of  x  e  C*  such  that  x(0)  e  S. 

(1)  Theorem.  For  each  x  e  Cg  there  exists  a  unique  pair  of 
functions  y  e  CK+1  and  s  c  CK  satisfying 

(2)  *k(t)  -  xfc(t)  -  yk(t)  +  70(k)(t)»  k-1,  ...  K  and  t  ^  0  , 

(3)  yk<«)  1*  increasing,  with  7k(0)  ■  0  (k  ■  1,  ...,  K+l), 

(4)  x(t)  €  S  ,  t  £  0  , 

(5)  /  <bk  '  *7k<*>  "  0  *  k  "  1 . .  and  t  >  0  , 
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(6)  /  [(K -*.(•))  a  *.<s)]  dyk(s) 

0  *  j«n(k)  3 

and 


0. 


k  -  Iifl, 
t  >  0  , 


t 

(7)  /  [  a  *.(s)]  dyr+i<*)  ■  0  *  • 

o  jen(K+i)  J  * 1 


K  and 


Moreover,  setting  y  -  4»(x)  and  z  -  b(x),  we  have  the  following: 


(8)  Both  4>  and  +  are  continuous  uappings  on  Cg  . 

(9)  Fix  x  c  Cg  and  T  >  0.  Define  x*(t)  =  *(T)  +  x(Tft)  - 
x(T),  F*(t)  s  y(T*t)  -  y(T),  and  z*(t)  =  »(TH).  Then 
y*  ■  4»(x*)  and  a*  •  +(x*). 

(10)  Suppose  x  -  x'  on  [0,t],  then  <j>(x)  -  <tfx’)  and 
♦(*)  -  ♦(x')  on  [0,tj . 

The  proof  of  Theorem  1  is  given  in  Sections  1,  2  and  3.  In 
Section  4  we  produce  a  convenient  bound  for  y.  This  bound  will  be  of 
lntereat  only  in  Section  5.4. 

Convention.  For  the  remainder  of  this  chapter  the  symbol  cKk) ,  when 
used  as  a  subscript,  will  be  shortened  to  simply  o.  For  example, 

-  *„<»  “  xoOt)  *  V  "* ,0  0,,• 

4.1  Existence  and  Uniqueness 

We  begin  by  proving  that  conditions  (2)-(7)  are  equivalent  to  the 


conditions 


f 


(11)  y.(t)  -  sup  (x.  (s)  +  y  (a)  ”  b.  )'  ,  k  -  1,  2,  ...  ,L 

k  0<«<tnt  a 


and  t  ^  0  , 


(12)  y.  (t)  -  sup  v  (y,(a)  -  x.(s))+  v  (x.  (s)4y  (a)-b.)+, 

0  <  a  <  t  j«n(k)  3  3  k  a  k 


Lrf 1  <  k  <  K  and  t  >  0  , 


(13)  y-.,(t)  "  *«P  v  (y,(«)  ~  x.(a))+  . 

0  <  a  <  t  jen(K+l)  3  3 


Suppose  Chat  y  satisfies  (2)-(7).  To  verify  the  forward 
Implication  we  start  by  showing  that  condltiona  (3)  and  (4)  imply  the 
weaker  conditions. 


(14)  y.  (t)  >  sup  (x.  (s)  ♦  y  (s)  -  \ )*  ,  k  -  1,  2,  ...»  K  and 
°<«<t  0 

.  t  >  0  , 


(15)  y.(t)  >;  sup  v  (y.(e)-x.(s))+  ,  I*  <.  k  <  K+ 1  and 

0  <  s  <  t  JcII(k)  3  3 


t  >  0  . 


Observe  that  0  <  Xj(t),  J  «  n(k).  Implies  that  yfc(t)  £  yj(t)-Xj(t). 
furthermore,  since  y^t)  >,  y^s)  2  y^CO)  "  ®  (t  >_  s  0),  it  is  now 
obvious  that  yfc(t)  :>  Ajcn(k)*7J^“,lJ^,^+  for  *  €  Th®  la8t 

line  la  equivalent  to  condition  (15).  In  similar  fashion.  It  can  be 
shown  that  (3)  and  (4)  Imply  (14).  Note  that  (14)  and  (15)  together 


■P 


(16)  y.  (t)  >  aup  v  (y. (s)-x. (s))+  v  (x.  (•)4y  (s)-bi  )+ 

”  0  <  •  <  t  JelKk)  3  3  *  °  * 

Lfi  £  k  <  K  and  t  >  0  . 

Fix  k  e  {W-l,  L+2 ,  K);  we  will  now  prove  thac  (6)  and  (16) 

together  laply  that  y^  satisfies  (12).  Begin  by  defining  x  = 
sup(t _>  0:  yfc  satisfies  (12)  on  [0,t]>.  The  definition  of  x 
leplles  that  (12)  is  satisfied  on  (0,t).  Suppose  In  contradiction 
that  x  <  •».  Then  by  the  continuity  of  s  and  y  it  follows  that 
(12)  Is  satisfied  on  By  virtue  of  (16)  and  Proposition  2.7 

there  exists  xq  >  x  such  that  to  is  a  point  of  Increase  for 

yk 

yk(T0)  >  sup  V  (y4(s)-x.(s))+  v  (x.  (s)  +  y  (s)  -  b.)+. 

°<«<*0  j€lI<k)  J  J  k  o  k 

The  last  Inequality  leplles  that  (bk-*k( xQ))  Aj  *j^To^  >  °*  “d 

thus  the  continuity  of  s  leplles  that  there  exists  6  >  0  such  that 

(b^-s^s))  AjeII(k)  *j(*)  >  0  for  •  e  V6**  Con»e<lu*ntly  *• 

now  obtain  the  Inequality 

tq+6 

/  (b. -x. (s))  a  *.(a)  dy.(s)  >  0  . 

0  ^  3  J«n(k)  3  * 
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The  last  Inequality  contradicts  (6),  and  therefore  x  ■  •.  Thus  yk, 
for  k  -  Lfl,  Id-2 ,  K,  satisfies  (12)  on  [0t<»).  In  similar 

fashion  It  can  be  shown  that  (5),  (7),  (14)  and  (15)  together  Imply 
(11)  and  (13). 

To  show  the  reverse  Implication,  begin  by  assuming  that  y 
satisfies  (11)-(13).  It  Is  easy  to  show  that  (11)-(13)  together  Imply 
(3)  and  (4).  Fix  k  e  {L+l,  Id-2,  K}.  The  function  yk 

satisfies  (6)  If  and  only  If  the  set  (t:  (b^-a^t))  Aj€n(k)  *  0} 

has  yk  measure  0.  By  the  continuity  of  z.  It  therefore  suffices 
to  show  that  yk  Increases  at  t  only  if  (h^-z^t)) 

Zj(t)  •  0.  Suppose  that  y^is  increasing  at  t,  then  yjt(t+e)  >  yk(t-e) 
for  e  >  0.  It  now  follows  from  (12)  that 

(17)  y.  (t+e)  -  sup  v  (y.(s)-x.(s))+ 

t-e  <  s  <  t+e  JeII(k)  3  3 

v  (xk(s)4yo(s)-bk)+  >  yk(t-e)  ,>  0  . 

Since  y^vt+e)  >  0,  we  can  omit  the  "positive  part  operator"  from 
(17)  to  obtain 


sup  v 

t-e  <  s  <  t+e  jell(k) 


(18)  yk(t+e) 


(yj(s)-Xj(s))  v  (xk(s)+yo(s)-bk) 


Since  x  and  y  are  continuous,  we  can  let  e+0  in  (17)  to  get 
yk(t)  *  vj£n(k)  v  (*k(t)+ya(t)-bk).  Therefore 

(bk“*k(t))  Ajen(k)  zj^  “  °*  11118  ahow8  that  (H)"(13)  imply  (6). 

In  similar  fashion  conditions  (5)  and  (7)  can  be  verified. 

From  now  on  we  will  only  consider  the  question  of  existence  and 
uniqueness  in  terms  of  conditions  (11)-(13).  Before  we  can  begin,  we 
need  to  Introduce  a  great  deal  of  new  notation. 

For  j  -  1,  2 . K+l  define  a  chain  to  station  j  to  be  an 

ordered  set  of  indices  c  -  (1.,  A0,  . . . ,  X  )  which  satisfies 

14  m 

(19)  1  <  <  L  ,  Xa  -  J  , 

and 

(20)  c  iK^k)  for  k  ■  2,  ... ,  m  . 

Define  C(j)  to  be  the  set  of  all  chains  to  j,  i.e. , 

(21)  C(j)  =  (c:  c  satisfies  (19)  and  (20))  . 

Becauae  o(k)  >  k  the  elements  of  any  chain  are  necessarily  distinct. 

He  will  say  that  our  network  is  M-stages  long  if  the  longest 
chain  to  K+l  has  M  elements,  i.e.. 


(22) 


M  =  nax{card(c):  c  «  C(K+1)} 


Define  the  stages  of  a  network  In  the  following  way. 

(23)  S(M)  =  {K+l )  , 

and 

(24)  JS(M-n)  =  (j :  j  e  II(k)  for  some  k  «  jS(M~n+l)  } 

for  n  -  1 . M-l  . 

Define  E(n)  for  n  -  1,  ....  M-l  as  follows: 

(25)  E(n)  S  S(n+1)  -  {1,  2,  ....  L>  . 

In  words,  JJ(n)  la  the  aet  of  stations  which  receive  inputs  froa 

l(n). 

We  now  Introduce  the  lnportant  inequality  constraints 

(26)  y.(t)  <  sup  (x.  (s)+y  (s)-b.  )+  for  k  -  1,...,L  and  t  >  0, 

0  <  •  <  t  o 

(27)  y.  (t)  <  sup  v  (y.(s)-x .(s))+  v  (x.(s)*y  (a)-b.)+ 

*  ”  0  <  s  <  t  Jen(k)  3  3  k  o  k 


for  k  ■  Id-1 ,  • . . , 


K  and  t  >  0 
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(28)  y„. , (t)  <  sup  v  (y  .(s)-x.(s)) ' 


°  <  s  <  t  jen(k) 


for  t  >  0 


Let  0  be  the  class  of  positive,  continuous,  increasing  (component¬ 


wise)  vector  functions  which  satisfy  (26)-(28). 

For  l  *  1,  ...,  fchl  define  U  _U  and  g^A^:  0  U  as 

follows: 


(29)  h£A)(y)(t) 


sup  v  (y  .(s)-x,(s))+  v  y.(s) 

<  s  <  t  IclKk)  J  J 


°  <  s  <  t  jcn(k) 

yv(t)  , 


for  k  e  E(i) 


for  k  l  EU) 


(30)  g£A)(y)(t) 


sup  (xk(s)+y(j(s)-bk)+  v  yk(»> 


yk(t) 


for  k  «  S(M-i) 


for  k  i  S(M-l) 


(31)  Remark.  It  is  easy  to  verify  that  h^  and  g^  preserve 
the  inequalities  (26)-(28).  Furthermore,  if  y  satisfies  (11)-(13) 
on  [0,T]  then  g^(y)  -  h^(y)  -  y  on  [0,T]. 


Row  define  H:  D  ♦  U  and  G:  0  ♦  D  by  tha  relations: 


(32) 
and 

(33) 


«,)  s  h»-»  .  h<*-» 


«,)  i  «(M-U  . 


•  •  •  •  • 


h(1)(y)  , 


g(1)(y>  • 


(34)  Renark.  H  and  G  Inherit  fron  and  g^  the  prop¬ 

erties  given  In  Renark  (31). 

Our  lnnedlate  goal  Is  to  show  that  If  y  c  U  satisfies  ( 1 1)— ( 13) 
on  [0,T]  then  (G*H)(y)  satisfies  (11)-(13)  on  [0.  Tt6]  where 
6  >  0.  lie  begin  this  task  with  the  following  renark. 

Renark.  Suppose  that  y  satisfies 

+  l~l 

(35)  sup  v  (y.(s)-*,(s))  <  y.(s)  for  kc  u  B(n) 

°  <  s  <  t  j«n(k)  J  3  n-1 

and  t  £  0.  Then  for  k  e  E(n),  h£*^(y)  satisfies  (35)  for 

t  >  0. 

(36)  Proposition.  For  k  e  (1+1,  ...»  K+l),  Hfe(y)  aatisfies  (35) 
for  t  >  0. 

Proof.  Use  the  previous  ranark  recursively  to  deduce  that  Hfc(y) 

y.1 

satisfies  (35)  for  k  c  £(n).  Finally,  note  that  the  surjective- 

y.1 

ness  of  o  inplles  that  u_  ,  E(n)  ■  {Lfl,  ...,  K+l}. 


Define  Lt  to  be  the  subset  of  U  which  satisfies  (35)  on 
[0»TJ ,  i.e. , 

(37)  Ijj,  =  {j  e  U:  for  k  “  Lfl,  ,  R+l,  y^  satisfies  (35) 

on  (0, T] }  . 


(38)  Proposition.  Suppose  y  e  U  end 

(39)  y  satisfies  (11)-(13)  on  [0,T]  , 

<*°>  T  €  ^  . 


(41)  sup  lx(s.)-x(s9)f  <  A  b  . 

T  <  Sj  <  s2  <  W-6  *  “  n-1 

Then  for  every  1  e  (1,  2,  ...,  IHl},  g^*\y)  e 

Proof.  He  need  to  prove  that  for  k  ■  Lfl,  ...,  K+l,  g£*^(y) 

satisfies 


(42)  sup  v  (g<A)(y)(s)  -  x.(s))+  <  g<A)(y)(t) 

0  <  s  <  t  Jcll(k)  3  3  * 


for  t  e  (0,  T+fiJ 


Observe  thst  (42)  Is  s  trivial  consequence  of  (40)  if  k  4  £(M-JtH). 
Suppose  that  k  e  ^(M-i+1)  and  let  t  t  10,  Tffi).  Since  f^(y)  -  y 
on  (0,T] ,  it  can  be  assuaed  that  t  e  [T,  Tffil.  It  suffices  to  sheer 
that  j  t  n(k)  satisfies 

(43)  sup  (g$A)(y)(s)  -  *,(s))+  <  g<A>(y)(t)  . 

T  _<  8  <  t  J  3 

Let  8  e  (T,t] •  If  gj^(y)(s)  -  yj(a),  then 

gjA)(y)(e)  -  ■  (yj(«)-*j(*))+  <  yk(t)  <  *£**(y)(t)  . 

^  gjA)(y)(«)  >  7j(e),  then  there  exists  u  e  [T,s]  such  that 
gjA^(y)(*)  "  »j(u)  +  yk(u)  -  bj.  Therefore 

(gjA)(y)(e)  -  Xj(s))+  -  (Xj(u)  -  Xj(s)  +  yk(u)  -  bj)+ 

<  (  ^  bn  -  bj  +  yk(u))+  <  yk(u)  <  g£A)(t)  . 

Consequently  (42)  aust  be  valid.  Q.E.D. 

(44)  Corollary.  If  y  <  0  satisfies  (39)-(41)  then  G(y)  e 

The  proof  of  the  corollary  follows  easily  froa  recursive  use  of 
Proposition  (38),  and  therefore  will  be  oaltted. 
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1— ark.  If  y  t  0  satisfies 


(45)  sup  (x.(s)  -  y  (a)  -  b.)+  <  y. 

0<s<t  *  °  *  * 

for  k  e  u£}  S(H-n)  sad  t  >  0,  than  for  k  e  S(M-n) ,  g£A)(y) 

sstlsflss  (45)  for  t  0. 

Also  observe  that  the  surjectiveness  of  a  laplles  that 
u£{  S(M-n)  -  {I,  2,  ...»  K}. 

How  use  the  previous  remark  recursively  to  deduce  the  following 
proposition. 

(46)  Proposition.  If  y  <  0  then  Gfc(y)  set Is If es  (45)  for 

k  ■  1,  ....  K  and  t  >  0. 

He  now  Introduce  the  following  Important  result. 

(47)  Proposition.  If  yc  0  and  y  satisfies  (11)-(13)  on  [0,T], 

then  (6*H)(y)  satisfies  (11)-(13)  on  [0.  Tffi] ,  where  6  satisfies 

K 

sup  lx(s. )  -  x(s.)l  <  A  b  . 

T  <  Sj  <  s2  <  Tffi  1  n-1 

Proof,  laaark  (34)  and  Proposition  (36)  together  guarantee  that  H(y) 
satisfies  (39)-(41).  Corollary  (44)  guarantees  that  (G»H)(y)  < 

Lptg.  Proposition  (46)  guarantees  that  (C«H)(y)  satisfies  (45)  on 


[0,»).  Itiark  (34)  laplles  that  (G»H)(y)  c  0.  Observe  that 
(G*H)(y)  e  n  U  and  condition  (45)  together  inply  that 
(G*H)(y)  satisfies  (11)-(13)  on  [0,  Tffi].  Q.K.D. 

Let  A  and  N  be  defined  as  follows: 


(48)  A(e)  s  sup (6  >  0;  sup  l(x(s.)-x(s9) I  <  e)  , 

°<s  i£s  ^s  i+6<T  1 

and 

K 

(49)  N  5  [T/A(  a  b  )]  +  1  . 

n-1  11 


Reaark.  When  necessary  we  will  append  arguaents  to  A(e)  and  N  to 
indicate  their  dependence  on  x  and  T. 

(50)  Leaaa.  (G«H)N(0)  satisfies  (11)-(13)  on  [0,T], 

Proof.  Observe  that  0  «  JJ,  and  thus  Proposition  (47)  laplles  that 
(G*H)(0)  satisfies  (11)-(13)  on  [0,  A(a*  .  b  )J.  Now  by  induction 

TP1  U 

the  result  will  follow.  Q.E.D. 

Define  4>(x)  as  follows: 

(51)  *(x)  s  (G«H)N(0)  . 


Due  to  typographical  considerations,  we  will  often  use  y  ■  4>(x) , 
except  when  x  Is  allowed  to  vary. 


Me  will  now  show  that  4>(x)  la  tha  unlqua  el  ament  of  U  which 
satlafiaa  (11)-(13).  Wa  begin  by  showing  that  4>(x)  is  tha  "least" 
solution.  Obssrvs  that  if  w  e  0  which  satisfies  (11)-(13)  on  [0,T], 
than  (G*H)(w)  -  w  on  (0,TJ.  Sines  G»H  is  a  monotonlcally 
Increasing  operator,  it  follows  that 

(52)  *(x)  S  (G.H)W(0)  <  (G«H)N(w)  -  w  on  (0,T]  . 

Tha  following  remark  is  a  direct  result  of  Proposition  2.11. 

(53)  Remark.  If  w  satisfies  conditions  (11)-(13)  on  [0tT]  and 
is  increasing  at  t  c  10, T]  then  either  *^(t)  ■  b^,  or  there 

exista  J  c  n(k)  such  that  **(t)  ■  0. 

For  tha  remainder  of  this  section,  let  y  -  4>(x)  and  w  c  U, 
such  that  w  satisfies  (U)-(13)  on  [0,T].  The  functions  y,  w 
satisfy  the  important  order  relationship  given  in  the  remark  below. 

(54)  Remark.  Suppose  that  for  t  c  10, Tj,  ^(t)  ■  0  and  *.“>  > 
yfl(t).  Then  a^(t)  >  yfc( t). 

The  next  proposition  is  essential  to  the  proof  of  the  uniqueness 
of  y. 

(55)  Proposition.  If  the  functions  y  and  w  given  above  satisfy 

(56)  y  ■  w  on  I0,tl  . 
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(57) 


•up  !■"(..)  -  *w(s,) I  <  a  b  /2  , 
and 

(58)  there  exist*  k  e  {Lfl,  ...»  K)  such  that  z£(t)  -  0  , 

then  *,,(0  -  yc(t). 

Proof.  Suppose  In  contradiction  that  w  (t)  >  y  (t).  Remark  (54) 

a  o 

implies  that  «^(t)  >  yfc(t).  Proposition  2.7  now  implies  that  there 
exists  tj  t  ( t» t J  such  that  v^Uj)  >  y^Ctj)  and  is  increasing 
at  tj.  Raaark  (53)  lilies  that  either  x*^)  “  or  there  exists 
kj  e  n(k)  such  that  x^Ctj)  -  0.  Conditions  (57)  and  (58)  together 
disallow  the  former  possibility.  Therefore,  we  deduce  that  there 
exists  kj  e  n(k)  such  that  sJ^tj)  ■  0  and  ^(tj)  >  7k(t,). 

Observe  that  tj  and  k^  satisfy  our  hypotheses  on  k  and  t. 
Therefore  by  inductively  using  the  previous  argument  we  can  deduce 
that  there  exists  (k^,  k^,  ...»  kf)  and  (tj,  t^,  ...»  tf)  which 
satisfy: 


(59) 

w 

<V* 

0 

and  w.  (t.)  > 

J-l  3 

yfc  (t.)  ,  J  -  1,  ...»  r, 
J-l  3 

(60) 

kJ 

-i  •  °(y 

where  ■  k 

and  J  •  1,  ...»  r  » 

(61) 

<  (*» 

V 

jl  where  tQ  -  t 

and  J  •  1,  ...»  r  » 

and 

(62) 

K 

C  (1. 

2. 

. . . »  L)  . 

Condition  (59)  and  Ranark  (54)  togathar  imply  that  wkr(tr)  >  7kr(tr). 
By  imitating  the  primary  argument,  me  deduce  that  there  exlata 
trfl  «  (*»«*!  *uch  >  7kr(tr+l)  that  wkr  la 

increaaing  at  tj+i.  Remark  (53)  implies  that  ak^jUr+l)  •  b^^. 
But  the  equality  ^[^(tj)  ■  0  and  condition  (57)  imply  that 
*kr(trtl)  i  aJJr(tr)  +  b^  /2  <  This  contradiction  implies  that 

our  Initial  assumption  is  wrong.  Therefore  (t)  - 

Q.E.D. 

(63)  Lemma.  Let  y  -  4<(x) ,  and  suppose  that  w  «  U  satlsf ies 
(11)— ( 13)  on  [0,T].  Then  y  ■  w  on  [0,TJ. 

Proof.  Set  x  =  aup{t  <  T:  y  ■  w  mi  [0,tj>.  The  continuity  of  y 
and  w  implies  that  y  ■  v  on  [0,tJ»  Since  a*  is  continuous 
there  exists  t  >  x  such  that  xv  satisfies  (57).  Now  define 

(64)  1  s  max( (-1 )  u  (n  for  which  there  exists  6  >  0  such  that 

wfc(a)  «  yk(a)  whenever  a  e  10;  t+6]  and 
n 

k  €  u  S(M-m)}). 
wpO  “ 

Suppose  in  contradiction  that  1  <  M-l.  By  definition  of  1  there 
exists  k  c  £(16*1-1)  and  tQ  c  (x.t]  which  satisfy  0  <  yk(tQ)  < 
wk(tc).  Proposition  (2.7)  implies  that  we  may  assume  without  loss  of 
generality  that  w^  la  increasing  at  tg.  Remark  (53)  Implies 


that  either 


(66) 


Vt(,>  “ 0 


nhere  kQ  e  n(k) 


We  will  now  show  that  only  (66)  is  possible.  If  k  ■  K+l  then  only 
(65)  Is  possible.  If  k  <  K+l  then  suppose  (65)  is  true.  He  obtain 

<67)  bk  “  *k(t0)  "  xk(t0)“wk(t0)4iro<t0) 

*  VtO)'Wk(tO)‘l7o(tO)  <  xk(tO)“7k(tO)t3ra(tO)  * 

Line  (67)  laplies  that  <  xj^tg)  £  k , .  Therefore  we  deduce 
that  only  (66)  la  possible.  Proposition  (55)  now  laplles  that  w^(tg) 
-  yk(tQ),  but  thla  contradicta  our  asaunption  that  w^Ctg)  >  yk(t0). 
Therefore  our  Initial  aasuaption  that  1  <  M-l  wust  be  false,  and 
thus  1  ■  M-l.  The  definition  of  1  lnplies  that  there  exists  6  >  0 
such  that  w  «  y  on  (0,  t+6] .  The  last  line  contradicts  our  defini¬ 
tion  of  x.  Therefore  x  ■  T  and  thua  w  »  y  on  [0,T].  Q.E.D. 

4.2  Continuity  of  the  Mapping 

He  begin  by  defining  the  napping  C*  ♦  C*  by 

(68)  6k(x)  s  \  ~  4*k(*)  +  »  for  k  -  1,  ...»  K  . 


(69)  Theorem.  The  mapping  x  +  (<j»(x),  $(x))  Is  continuous  from 
CK  to  C2K+1  with  respect  to  the  topology  of  uniform  convergence 
on  finite  lntervels. 

Proof .  Since  is  s  product  space,  it  suffices  to  show  that 

both  4>(x)  end  +(x)  are  continuous.  We  begin  by  showing  that  <j,(x) 
is  continuous.  We  will  now  Interpret  h^*\  H  and  g  as  being 

mappings  from  C^K+^  to  C2***  in  the  following  way: 

h^(y,x)  =  (h^(y),  x)  for  1-1,  ...»  M-l  , 

g*^(y,*)  =  (g*^(y),  *)  for  1-1,  ...»  M-l  , 

H(y,x)  -  (H(y) ,  x)  , 

and 

G(y,x)  ■  (G(y),  x)  , 

where  h(A)(y),  g(A)(y)i  H(y)  and  G(y)  are  defined  by  (29),  (30), 
(32)  and  (33).  Since  the  continuity  of  mappings  is  preserved  by 
composition,  it  follows  that  H  and  G  are  continuous  as  long  as 
h^  and  g^  are  continuous  maps  for  1  «  {1,  ...,  M-l).  We  will 
now  prove  that  h^  is  a  continuous  map.  Let  T  >  0  be  given.  We 
need  to  show  that  h^  is  a  continuous  mapping  on  C2K+*  [0  ,T] . 

Let  (y,x),  (y',x')  e  C2K+llO,T),  and  let  k  e  E(l); 


|hj;w(y.x>  -  h~V,*')<t)| 

-  I  «up  V  (y.(s)-x,(s))+  V  y.  (•) 

'O  <  s  <  t  j«n(k)  J  J  * 

•up  v  (y!(s)-x!(s))+  v  y'(«) I 

0  <  s  <  t  jell(k)  J  J  K  1 

<  sup  lx(s)**x*  (•)  I  +  2  sup  ly(s)  -  y’(s) 
0  <  •  <  t  0<i<  t 

• 

£3  sup  l(y(s),x(s>)  -  (y' (s) ,x* (■)) I 
0  <  s  <  T 

-  3l(y,x)  -  (y' ,x')l  . 

Thsrsfors, 

(70)  |  sup  h<A)(y,x)(t)  -  h5^>(y' ,x')(t) I  <  3l(y,x)  -  (y’,x')l 

'0  <  t  <_  T  1 

It  Is  saally  vsriflsd  that  (70)  holds  for  k  i  E(l).  Thsrsfors  us 
obtain 

(71)  lhU)(y,x)  -  hU)(y\x')l 

s  sup  |Ktl  |h^A)(y,x)(t)  -  h£A)(y’,x’)(t)| 

0  <  t  <  T  k—l  K  * 


Line  (71)  laplles  that  h<A>  18  continuous .  In  similar  fashion  It 
can  be  shown  that  Is  continuous.  Therefore  G  and  H  must  be 

continuous,  and  thus  (G»H)n  Is  a  continuous  map  for  any  fixed  n. 
Moreover,  the  mapping  x  ♦  (0,x)  is  a  continuous  mapping  from  C* 
to  C2*1.  How  observe  that  (<p(x)  ,x)  ■  (G»H)*^x\o,x).  Suppose  that 
N(x')  >  N(x) ,  then  the  invariance  of  4>(x)  Implies  the  equation 

(G.H)N(x,)(0,x)  -  (G.H)N(x,)“N(x)(<j,(x),  x)  -  (4<x),  x)  . 

# 

Therefore,  It  suffices  to  show  that  N(x)  is  a  locally  bounded 
function  of  x.  Define  M(x)  by 

K 

M(x)  5  [l/A(x,  a  b/2)]+l  . 

n-1 

If  x'  €  C*[0,T]  such  that  8uP()<t<T  l*(t)-x' (t)  I  <  a*^  bQ/4,  then 
N(x')  <  M(x).  To  see  the  last  Inequality,  note  that 


eup  lx'(s.)  -  x'(s2)l 

0  <  8j  <  82  <  8j+A  <  T 


<  sup  [lx'(s.)  -  x(s.)l 

0  <  8!  <  »2  <  8i+A  <  T 


+  lx(Sj)  -  x(s2)l  +  lx(s2>  -  x'(s2)l] 


K 

A 

n«l 


Vi  +  i  +  i> 


K 

A 

n«l 


t 
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where  A  ■  A(x,  a^j  bQ/2). 

Therefore  by  definition  of  A  we  find  that  A(x* ,  aq^  bft) 

A(x,  bQ/2).  The  definition  of  N  and  M  together  imply  that 

N(x')  <  M(x).  We  now  see  that  the  mapping  (4»(x'),  x’)  ■ 

(G*H)  (0,x')  is  locally  a  fixed  power  of  G*H.  It  is  now  clear 

that  (<|»(x),  x)  and  4>(x)  are  continuous.  Since  $(x)  -  (<ti(x),  x)»A, 
where  A  is  a  2K+1  by  K  matrix,  it  also  follows  that  A  is 
continuous.  Q.E.D. 

4.3  Additional  Properties 

(72)  teams.  Fix  x  e  C§  and  T  >  0.  Let  y  -  4>(x)  and  z  »  $(x) 
as  before.  Define  x*(t)  =  *(T)  +  x(Tft)  -  x(T),  y*(t)  “  yCW-t)-y(T) , 

and  **(t)  -  s(Tft).  Then  y*  •  4>(x*)  and  **  -  $(x*). 

Proof.  If  y*  satisfies  ( 1 1>— ( 13)  for  x*  then  the  equality  y*  » 
4»(x*)  will  follow  from  Lemma  (63).  We  begin  this  task  by  showing 
that  y*  satisfies  (12)  for  x*.  Let  k  e  (tel ,  ...,  K)  and  t  >  0 

be  given.  Suppose  that  y£(t)  >  0,  then  yfc(Tft)  >  yk(T).  From  (12) 

it  follows  that 


5 


y*(T+t)-y*(T) 


-  sup  v  (y  (s)-x  (s)-y.  (T))+  v  (x.(s)+y  (s)-y  (T)-b.)+ 

T<s<T+t  jell(k)  3  3  *  <  a  K  *. 

-  sup  v  [(y.  (s)-y.(T)-x  (s)-Hc.(T)+y  (T)-x.(T)-y.(T))+ 

T  <  a  <  Tft  jelKk)  J  3  3  3  3  3 

v  (xk( 8 ) -xk( T)+y 0( s ) -y o( T)-txfc( T)+y^(T) -yk( T) -bk)  +] 

-  sup  v  (y*(s-T)-x*(s-T))+  v  (x*(s-T)+y*(s-T)-b.)+  . 

T  <  s  <  Tft  jfill(k)  J  J  a 

The  last  equality  Is  obtained  from  the  previous  expression  by  using 
the  definitions  of  y*  and  x*.  If  u  «  s-T  Is  substituted  for  s 
in  the  last  line  we  deduce  that 

y.  (Tft)-y.  (T)  -  sup  v  (yt(u)-x*(u))+  v  (x*(u)+y*(u)-b.  )+ 

°  <  u  <  t  jcll(k)  3  3  a  * 

The  last  line  shows  that  y*  satisfies  (12)  whenever  y£  >  0.  Let  us 
now  suppose  that  y£(t)  “  0.  Then  yk(T+-t)  ■  yk(T) ,  and  thus  (12) 
lwplies 

yv(TH:)  >  sup  v  (y  .(s)-x.(s))+  v  (x.  (s)4y  (s)-b.  )+ 

*  “  T  <  s  <  T+t  J«n(k)  33  K  a  * 

-  sup  V  (y?(s-T)-x*(s-T)+y.  (T))+ 

T  <  s  <  Tft  jelKk)  3  3 

v  (x^(s-T)+y*(T-t)4yk(T)-bk)+  . 
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The  last  equality  follows  again  by  simple  substitution.  Now 
substitute  u  ■  s-T  to  obtain 


(73)  y.  (Tft)  2  8“P  v  (y*(u)-x*(u)+y .(T))+ 

K  o  <  u  <  t  j£n(k)  J  3 


v  (x*(u)+y*(u)+yk(T)-bk)+  . 


Since  yfc(Tft)  -  yfc(T) ,  it  follows  from  (73)  that 


(74)  0  -  sup  v  (y$(u)-x*(u))+  v  (x*(u)4y*(u)-b. )+  . 

0  <  u  <  t  j€n(k)  3  3  a 

Therefore,  it  now  follows  that  y*  satisfies  (12)  for  x*.  In 
precisely  the  same  fashion  it  can  be  shown  that  y*  satisfies  (11) 
and  (13)  for  x*.  Thus  we  have  shown  that  y*  ■  4>(x*).  It  remains  to 
show  that  x*  ■  $(x*).  Let  k  e  {1,  2,  ... ,  K}  be  given, 

♦k(x*)(t)  =  x*(t)-«J^(x*)(t)  +  <t»<j(x*)(t)  -  x*(t)-y*(t)+y£(t) 


-  *k(T)+xk(Tft)-xk(T)-yk(Tft)+yk(T)+y(j(T4-t)-yo(T) 


-  xk(Tft)-yk(Tft)+y<j(Tft)+*k(T)-*k(T) 


-  ^(Tft)  =  **(t)  . 


Therefore,  it  now  follows  that  **  •  ♦(**)•  Q.E.D. 

In  the  preceding  b  was  taken  to  be  fixed;  in  this  pert  b  will 
be  allowed  to  vary.  Let  x  e  Cg  and  b  •  (bj,  ...»  bg)  where 
bfc  >  0.  Define  <|>(x,b)  to  be  the  function  determined  by 
(11)-(13).  Define  <}(x,b)  in  terms  of  x  and  4<x,b)  according  to 
(68). 


(75)  Lemma.  The  functions  <J>(x,b)  and  *(x,b)  satisfy 

(76)  b)(«)  •  r“1/2  4>(*.  rl/2  b><r*>  » 

and 

(77)  ♦(^471*  b)(0  “  r"1/2  ♦(x*  rl/Z  b)(r#)  *  ■**•“  r  >  °* 

rA/ 

Proof.  Set  w  s  $(x,  r1^2  b)(r»).  W*  will  »bow  that  r  1 ^2  w 
satisfies  (11)-(13)  for  x(r«)  r“1/2  and  then  apply  Lemma  63  to 
deduce  (76).  Let  k  «  (Lrfl,  ...»  K)  and  t  >  0.  The  function  w 

satisfies  by  definition: 


(78) 


w.  (t)  -  sup  v  “  x.(s))+ 

*  0  <  s  <  rt  j«n(k)  J  J 

v  (%<■>  +  V?)  -  *l/J  \f  ■ 


Substitute  u  -  s/r  into  (78)  and  simplify  to  obtain 
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(79) 


3 

! 

! 


h 


*k(t)  -  sup  v  (w.(u)  -  x4(ur))+ 

0  <  u  £  t  jell(k)  ^  ^ 

v  (x^ur)  +  wo(u)  -  r1/2  l»k)+  . 

1/2 

Divide  equation  (79)  by  r  to  deduce 

(80)  if 1/2  w  (t)  -  sup  v  (w.(u)  r'1/2  -  x4(ur)  r“1/2)+ 

0  <  u  <  t  Jen(k)  J  J 

v  (x^ur)  r-1^2  +  »o(u)  r-1^2  -  b^)*  . 

Equation  (80)  implies  that  r”1^2  w  satisfies  (12)  for  x(r»)  r’1^2 

and  b.  Similarly  it  can  be  shown  that  r”1^2  w  satisfies  (11)  and 

—1/2 

(13)  for  x(r«)  r  and  b.  It  now  follows  that  (76)  is  valid. 

To  prove  (77),  begin  by  observing  that 

>k(x(r.)  r"1/2,  b)  ^(X(r.)  r“1/2,  b)  +  <j,a(x(r.)  r"1/2,b)  . 

Use  (76)  to  deduce  that 


♦k(x(r»)  r  1 ^2,  b) 


-  x(r.)  r”1/2  -  r“1/2  <^(x,  r1/2b)(rO  +  r"1/2  4,  (x,rI/2b)(r .) 


r~1/2  U(rO  -  4^(x,  r1/2  b)(rO  +  4-  (x,  r1/2b)(r.)l 


r“1/2  ^(x,  r1/2b)(r.)  . 


i 
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Therefore  (77)  holds  es  well 


Q.E.D 


(81)  Proposition.  Let  x,  x'  e  Cg,  end  suppose  x  ■  x'  on  [0,t], 
then  4>(x)  •  4»(x')  end  +(x)  -  d(x')  on  [0,tJ. 

The  proof  of  Proposition  81  can  be  easily  derived  froe  equation 
(51)  end  the  definition  of  G»H.  Therefore  we  oait  the  proof. 


4.4  A  Bound  for  the  Boundary  Process 


Let  w  e  CK+1,  x  e  CK,  and  T  >  0  be  given. 


(82)  Proposition.  The 


aapplng  6«H  satisfies 


(83)  l(G*H)(w,x)  I  S  sup  l(G*H)(w,x)(t)  I  <  2M(lxl  +  Iwl)  . 

0  <  t  <  T 

Proof.  Observe  that  and  h^*)  satisfy 

(84)  lh(A)(wfx)l  <  Iwl  +  Ixl  ,  for  1  -  1,  2,  ...»  M-l  , 

and 

(85)  lg(A)(w,x)l  <  Iwl  +  Ixl  ,  for  1  -  1,  2,  ...,  M-l  . 

Since  G»H  5  g^^  •  •••  •  g^  •  •  •••  •  h^\  line  (83)  now 

follows  from  (84)  and  (85)  by  recursion. 


(86)  Corollai 


The  napping  x  +  (G*H)(0,x)  satisfies 


(87) 


I (G«H)(0,x) I  <  2N( Ixl) 


(88)  Lew.  Let  x  e  C*  be  given.  Then 


K 

(89)  l4»(x)(T)l  <  N(x)  •  4M(  v  b  )  . 

n-1  “ 


where  N  =  N(x)  Is  defined  by  (49). 


Proof.  The  proof  proceeds  by  Induction  on  N.  If  N  •  1  then  (49) 


lnplles  that 


K 

(90)  sup  lx(0)  -  x(s) I  <  a  b  . 

0  <  s  <  T  Vi  ° 

Since  x(0)  e  S,  It  follows  froa  (90)  that 


K  K 

(91)  Ixl  <  lx(0)l  +  a  b  <  2  v  b  . 

n-1  n“  n-1  ” 

Line  (91)  and  Corollary  86  together  lnply  (89). 

Now  suppose  by  Induction  that  (89)  holds  for  all  x  e  such 
that  N(s.T)  <  ■  and  all  T  >  0.  Let  x  c  CK  such  that  N(x,T)  - 
srl.  Define  x*  e  CK  as  follows. 


(92)  x*(t)  5  +(x)(A)  +  x(t+A)  -  x(A)  , 

niwrt  A  *  A(x,  bQ)  is  defined  by  (48). 

Tbs  definition  of  N  laplles  that  N(x* ,  T-A)  <  a.  Therefore 

K 

(93)  l*(x*)(T-A)l  <  (H(x)-l)  4M(  v  bn)  . 

n-1  “ 

Leaae  72  laplles  that 


(94)  4»(x)(T)  -  <J»(x)(A)  +  4»(x*)(T-a)  . 

Linas  (93)  and  (94)  and  tha  induction  hypothesis  together  laply  (89). 

QeBeDe 

(95)  Corollary.  Let  x  (  C*  satisfy  x(0)  -  0.  Then 

K 

(96)  sup  l4(x.'»x)(T)  I  <  H(x)  4M(  v  b  )  . 

Xq  €  S  b»1 

Proof.  Observe  that  N(x)  ■  N(Xq+x)  for  any  Xq  c  S.  Line  (96) 
now  follows  froa  Leans  88.  Q.E.D. 
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CHAPTEK  5 

■DUCTED  BUmil  MOTIOD 

This  chapter  Is  devoted  to  study  of  the  K-dlnenslonal  stochastic 
process  Z  5  +(X),  where  A  the  reflection  napping  of  Chapter  4 
and  X  Is  a  K-dlnsnslonal  Brownian  Motion  (with  arbitrary  drift  and 
covariance  aatrlz).  It  will  be  shown  that  Z  Is  a  diffusion  process* 
and  sosk  of  Its  properties  will  be  explored.  In  particular*  It  will 
be  shown  that  Z  has  a  unique  stationary  distribution*  and  an 
analytical  characterization  of  that  distribution  will  be  developed. 

5.1  The  Diffusion  Property 

This  section  begins  with  the  introduction  of  notation  necessary 
for  defining  a  diffusion  process  on  ■*. 

Let  I  be  a  rectangle  on  XK  and  let  C1  be  the  space  of 
continuous  functions  fron  [0,«)  to  I.  Let  (Q*JF)  be  a  eeasurable 
space  and  suppose  Z:  Q  C1.  Denote  Z(ti>)(t)  by  Z(t).  Let  F* 
be  a  filtration  of  <r*flelds  such  that 

(I)  Z(t)  c  c  F  ,  for  t  >  0  . 

For  each  x  c  I,  let  Fs  be  a  probability  aeasure  on  (Q*F).  Let 
xi  Q  ♦  [0,-].  Ms  say  that  t  Is  a  Markov  tins  relative  to  {F|., 
t  >  0}  and  (P*.  x  c  1}  If 
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(2)  {t  <  t)  €  r  for  t  >  0  , 

*"~v  " 

and 

(3)  Px(t  <  •)  -  1  for  x  €  I  . 

Lot  Ft  be  the  pra-r  field,  l.e., 

(4)  P  s  {A  c  P:  A  n  {t  <  t>  e  r  for  t  >  0}  . 

“t  —  — j 

We  will  coll  <Z(t) ,  t  £  0>  o  diffusion  on  I  If 

(5)  PX(Z(0)  -  x)  -  1  for  oil  x  c  1  , 

end  for  oil  bounded,  continuous  functions  on  I  end  oil  Merkow  tines 
x 

(6)  f[f(Z(tH)|f']  -  lI(t>(f<Z<t))]  o.o.  P*  . 

Por  the  remainder  of  this  chapter  let  Q  ■  C*.  Denote  a 
generic  element  of  Q  by  u  -  ((u>i(t),  ...,  u*(t));  t  0).  Lot 
X  be  the  coordinate  process  on  Q,  l.e., 

(7)  X(<i>,t)  -  «(t)  for  t  >  0  and  <■>  c  Q 
Denote  X((d,t)  by  X(t). 

Let  P  be  the  Borel  field  on  Q  generated  by  the  topology  of 
uniform  convergence  on  compact  Intervale.  Let  s  o{X(s) : 
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0  <  s  <  t+e).  For  each  x  c  RK,  let  P*  be  Che  probability 
measure  on  (Q,£)  under  which  X  is  a  Brownian  motion  with  drift 
vector  p,  positive  definite  covariance  matrix  A,  and  starting  state 
x.  Define  Z  -  <|>(X)  and  Y  -  <J»(X)  with  the  reflection  map  (4>,+) 
given  in  Chapter  4. 

Let  x  be  a  Markov  time;  define  X*  and  Y*  os  follows: 

(8)  X*(t)  =  Z(x)  +  X(x+t)  -  X( x)  for  t  >  0  , 
and 

(9)  Y*(t)  =  Y(  x+t)  “  Y(x)  for  t  >  0  . 

We  will  now  prove  that  (Z(t),  t  2,  0>  is  a  diffusion  on  S.  But 
first  we  need  to  prove  several  preliminary  propositions. 

(10)  Proposition.  For  every  t  >  0,  (Y(t),  Z(t))  e  Ff. 

Proof.  This  measurability  property  follows  easily  from  the  measur¬ 
ability  preserving  property  of  G*H  (see  Lemma  4.50).  The  measur¬ 
ability  of  G«H  in  turn  follows  from  Proposition  2.16. 

(11)  Proposition.  Every  Markov  time  x  and  every  bounded  random 
variable  W  e  c{Z(x),  X(x+t)  -  X(x),  t  >  0)  together  satisfy 

(12)  E*!*^]  -  EXlw|z(x)J  a.s.  Px  for  x  e  S  . 

Proof.  By  the  usual  monotone  class  argument  it  suffices  to  show  that 
W  -  fQ(Z(x))  •  f1(X(x+t1)-X(x))  •••  fQ(X(x*n)  -  X(x)) 
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satisfies  (12),  where  f j ,  j  "  1,  n,  ie  e  bounded  Borel 


function  end  0<t^<t2<***<  tQ.  Observe  that  If  Z(x)  e  P  ,  it 


follows  thst 


(13)  B*tW|F^)  -  fQ(Z(x))  B*[f  j(X( tK j )-X( t) ) 


fn(X(x+tn)-X( x)) 


By  the  strong  Markov  property  of  Brownian  notion  It  follows  froa  (13) 
that 


(14)  x'lWl^J  -  fQ(Z(x))  EXtf1(X(r^1)-X(x)) 


•••  f  (X(tK  )-X(t))J 
ii  n 


Notice  that  the  last  expression  Is  a  function  that  belongs  to  o(Z(t)) 
and  therefore  (12)  oust  hold.  It  now  suffices  to  show  that  Z(x) 
e  Ft.  To  show  this,  begin  by  observing  that  If  t  Is  countable  the 
result  Is  easy  to  prove.  Notice  that  xn  •  [nxHj/n  la  a  Markov 
tine.  Therefore  Z(xn)  e  FTn.  But  Ft  -  FTn.  Since  Z 

Is  continuous  we  have 


x(x)  ■  11*  Z(x  )  6  a  F  -  F 

n  •  Q  n-l^n  “* 


Q.E.O. 


< 
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(15)  Lemma. 


Ex[f(Z(t+t))|Pt]  -  EZ(x)[f(Z(t))J  a. 8.  PX 

and 

Ex[g(Y(x+t)  -  Y^))]^]  -  EZ(T)[g(Y(T+*)  -  Y( t) )  1  a.a.  PX, 
where  f  and  g  are  bounded,  continuous  functions. 

Proof.  Line  (4.9)  and  Proposition  10  together  Imply  that 

(16)  f(Z(t+t)),  g(Y(r+t)  -  Y(r))  e  o{X*(t),  t  >  0}  . 

Line  16  and  Proposition  11  together  laply  (15). 

(17)  Theorem.  The  process  (Z(t),  t  >..0}  is  a  diffusion  on  S. 

Proof.  Observe  that  (5)  follows  from  the  Identity  Z(0)  -  X(0). 
Condition  (6)  was  verified  In  Is—  15. 

5.2  Brgodiclty 

In  this  section  we  will  prove  that  Z  satisfies  the  conditions 
of  Theorem  2.59. 

(18)  Proposition.  Let  W  be  the  standard  K-dlaanaional  Brownian 
motion  on  [0,T]  with  W(0)  ■  0.  Suppose  B  Is  an  open  set  of  the 
fora: 
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I 

*  5  (y:  ly-xl  <  e>  ,  where  x  satisfies 

I 

<20>  *<t)  -  ct  ,  t  «  [0,T]  and  c  e  R*  . 

j  Then  P(W  c  B)  >  0. 

Proof. 

P(W  €  B)  -  P{  sup  lW(t)  -  ctl  <  e} 

0  <  t  <  T 

K 

-  n  p{  sup  k  (t)  -  c,.t|  <  c)  . 

k-1  0  <  t  <  T1  *  1 

Observe  that  if  c  ■  0  then  the  result  follows  from  elementary 
properties  of  1-dimensional  Brownian  motion.  For  <*  *  0,  the  usual 
likelihood  ratio  argument  (for  example,  see  (2.53)  above)  will  show 
that 

(21)  p(  lltU)  “  c.  t|  <  e)  >  0  .  Q.B.D. 

0  <  t  <  T  1  *  *  1 

(22)  Corollary.  If  X  is  any  fully  K-dlmensional,  Brownian  motion 
with  X(0)  -  0  then  P(X  e  B)  >  0. 


Proof,  fie  can  represent  X  as 


(23) 


X  -  AW  +  pt 


where  A  is  a  K  x  K  non-singular  matrix  and  p  is  a  K-dlmenslonal 
vector.  Observe  that  there  exists  6  >  0  such  that 

{w:  sup  lW(t)  -  A  *(c-p)tl  <  6}  c  (X  c  B)  . 

0  <  t  <  T 

Therefore  P(X  e  B)  >  0  follows  from  Proposition  18. 

(24)  Proposition.  The  process  Z  satisfies  property  (2.60). 

Proof.  Let  z,y  e  S,  and  T,e  >  0  be  given.  Define  Q  a  subset  of 
CK  as  follows: 

Q  s  {x  €  CK:  lx(T)  -  yl  <  e>  . 

Define 

B  5  {«:  IZ(T)-yl  <  e>  -  {u>:  X  e  ♦_1(Q)}  . 

Since  4  is  continuous  and  Q  is  open,  it  follows  that  $~1(Q)  is 
open.  Define 

4  *(0)-*  5  (x(t)-z:  x(t)  e  4  *(<))}  • 

Clearly  $”*(Q)-z  is  open.  Furthermore,  the  function  (1  -  t/T)z  + 
(t/T)y  belongs  to  4  *(0).  Therefore  x(t)  =  (t/T)(y-z)  belongs  to 
4~*(Q)-z.  Corollary  22  now  implies 
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(25) 


Pz(Z(T)  €  (y-e,  y+e))  -  P°(X  c  ♦”1(Q)-z)  >  0 


The  general  result  follows  easily  froa  (25).  Q.E.D. 

(26)  Proposition.  The  process  Z  satisfies  property  (2.61). 

Proof.  Let  f  e  C(S)  and  x  e  S  be  given.  Observe  that 

(27)  Ey(f(Z(s))  -  E°[f(*(y+X)(s))l  . 

Since  $  is  continuous  it  follows  that 

(28)  f($(y+X)(s))  -►  f($(xfrX)(t))  as  s  t  and  y  x  . 

Since  f  is  continuous  and  S  compact  we  have 

(29)  |f(*(y+X)(s))|  <  If  I  . 

Lines  (27),  (28),  (29)  and  the  Dominated  Convergence  Theorem  together 
imply  that 

(30)  11m  Ey(f(Z(s))  -  E*(f(Z(t))  .  Q.E.D. 

s+t,y-Mt 

(31)  Proposition.  Every  state  of  the  Brownian  motion  X  is 
diffusion-like. 
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Proof.  He  begin  by  observing  that  the  spatial  homogeneity  of  the  X 
process  allows  us  to  consider  only  the  0  state.  There  exist  a 
nonsingular  K  x  K  matrix  D  and  K-dimensional  vector  c  such  that 
W(t)  -  DX(t),  where  W  is  standard  Brownian  motion  with  drift  c. 
Define  Br  =  {D“lx:  Ixl  £  r>  and  t  by 

(32)  x  s  inf {s;  X(s)  c  &Br)  . 

Let  Q  be  a  measurable  subset  of  R+  x  aBf,  and  define  Q*  =  {(s,Dz) 
where  (s,z)  e  Q).  Thus  it  follows  that 

(33)  Px((t,  X(t))  «  Q)  -  PX((t,  W(t))  c  Q*)  . 

Line  (33)  and  Proposition  2.50  together  imply  that 

(34)  lim  sup  jpX((r ,  X(t))  e  Q))  -  P°((t,  X(t))  e  Q)  I  -  0  , 
x  ♦  0  Q  e  £ 

where  ([  is  the  class  of  Borel  measurable  subsets  of  Kf  x  3Br . 
Finally,  Px(x  <  •)  ■  1  because  Brownian  motion  always  escapes 
bounded  neighborhoods. 

(35)  Proposition.  The  diffusion-like  states  of  Z  are  dense  in  S. 

Proof.  Since  Z  behaves  like  X  in  the  interior  of  S,  the 
proposition  is  implied  by  Proposition  31.  Q.E.D. 


Proposition  2.59  now  implies  that  Z  is  an  ergodic  process 


5.3  A  Chang*  of  Variable  Formula 


IC  will  be  convenient  to  represent  X  in  the  form  X(t)  - 
W(t)+yt  where  W  =  {W(t)p  t  ^  0}  is  a  Brownian  notion  with 
covariance  A,  zero  drift  and  W(0)  -  X(0)  -  Z(0).  Then  we  have 


(36) 

where 

zk(t)  -  wk(t)  +  M^t)  , 

(37) 

Mk(t)  =  pkt  -  Yk(t)  +  Ya(t)  , 

t  >  0  , 

for  k.  -  1,  K.  Observe  that  Wk  is  a  martingale  over  {F  } 

and  that  ^  is  a  continuous  adapted  process  of  bounded  variation. 
Thus  each  is  a  continuous  semimartingale,  and  one  can  develop 

the  analytical  theory  of  vector  process  Z  from  the  following  version 
of  Ito's  formula:  For  twice  differentiable  functions  on  Rk  define 
the  (constant  coefficient)  differential  operators 


(38) 
and 

(39) 

and 

(40) 


K  K 

L  2  I  I  • 


.2  K  .. 

a —  +  y  u  M- 

A,  **i  ax  » 


i-i  j-i  axia*j  i-i 


d  =  y  -5 - L. 

k  ji(k)  axj  axk 


K+1  jcn^K+i)  axj 


for  k  -  1,  ... ,  K  , 


Observe  that  is  the  directional  derivative  in  the  direction  of 

reflection  at  the  boundary  (Zfc  -  b^)  u  ^Aj€n(k)  Zj  "  For 


k  “  K+l,  Dg+i  Is  the  directional  derivative  in  the  direction  of 
reflection  at  the  boundary  ^Ajcn(K+i)  zj  “  Let  ^  (for  *w>oth) 
be  the  class  of  functions  f(t,x)  that  are  continuously 
differentiable  in  t  0  and  twice  continuously  differentiable  in 

X  €  rK. 

(41)  Theorem.  If  f  e  S  then 

(42)  f(t,Z(t))  -  f(0,Z(0))  -  /  (s,Z(s))  +  Lf(s,Z(s))]  ds 

0  08 

+  l  /  ||  (s ,Z(s) )  dW.  (s) 
k-1  0  bxk  k 

K+l  t 

l  I  D.f(s,Z(s))  dY  (s) 
k-10  C 

for  all  t  0.  Here  the  integrals  involving  dW^(s)  are  of  the 
Ito  type,  and  those  involving  dY^(s)  are  defined  path  by  path  as 
ordinary  Riemann-Stieltjes  Integrals. 

Proof.  By  n^iHng  minor  changes  in  the  proof  of  the  Kunita~Watanabe 
[9]  change  of  variable  formula  it  can  be  shown  that  the  following 
equations  are  valid. 


(43)  f(t,Z(t))  -  f(0,Z(0))  +  /  f(s,  z(.))  ds 


K  t 


K  t 


+  Ji  oJ  K  1<*,Z<')>  iZk<,>  +  J,  l  *  «••*•»  d* 


K  K  t  .2 


+  I  I  I  /  ax^ax"  £(*»z(,))  **«<•>  <*M«>  » 

i-l  j-l  o  a*i°*j  1  J 


where  the  differentials  are  computed  from  (36)  and  (37)  in  the  obvious 
way  and 


dZ±(t)  dZj (t)  -  a  dt 


by  convention. 

Equation  (42)  is  now  obtained  from  (43)  and  (44)  by  simply 
collecting  terms. 


(45)  Definition.  Define  S*  as  follows: 


Sk  5  {*  €  S:  xfc  -  bk> 


for  k  ■  1,  ...,  L 


Sk  =  {x  «  S:  (  a  x  )  (* -b  )  -  0}  for  k  -  1*1,  ...,  K 
jell(k)  3  k  k 


(48)  S  .  5  (x  e  8:  a  x  -  0}  . 

Jcn(K+l)  3 
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(49)  Corollary.  Let  f  e  jS  and  suppose  In  addition  that 


(50)  D^f(t,x)  ■  0  for  x  «  and  k  -  1,  ...»  K+l 

over  the  Interval  0  <  t  <  T.  Define 

t  f. 

(51)  M(t)  =  f(t,Z(t))  -  /  f (s ,Z(s) )  +  Lf  (s,Z(s))  ]  ds  . 

0  °8 

Then  {(M(t),  j^);  0  <  t  <  T}  is  a  aartlngale. 

Proof.  If  (50)  holds,  then  each  tern  in  the  final  summation  on  the 
right  hand  side  of  (42)  vanishes,  because  Y^( •)  Increases  only  at 
those  tines  where  Z(t)  e  S^.  Thus  Theoren  41  lnplles  that 

K  t 

(52)  M(t)  -  M(0)  -  Y  /  ■£-  f(s ,Z(s))  dW,  (s)  ,  0  <  t  <  T 

k-1  0  9xk  k  “  “ 

Observe  that  the  continuous  functions  9/5xj  f,  ...,  d/dx^  f  are 
bounded  on  the  compactua  [0,T]  x  S.  Consequently  the  integrands  of 
the  Ito  integrals  of  (52)  are  bounded,  so  the  right  hand  side  of  (51) 
must  be  a  martingale. 

(53)  Corollary.  Let  h;  S  ♦  R  be  continuous.  Suppose  that  f  e  _S 
and  that  f  satisfies  condition  (50).  If 


(54)  J-  f(t,x)  +  Lf(t,x)  -  0 


9 


for  x  e  S  and  t  e  [ 0 ,T] 


and  If 
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The  renal nder  of  this  section  Is  devoted  to  proving  Theorem  59. 

(61)  Proposition.  Let  t  >  0  be  given.  Then  there  exists  at  <  • 
such  that 

(62)  E*(l Y(t) I )  <  at  for  x  e  S  . 

Proof.  Define  £(s)  ■  X(s)-X(0).  Observe  that  £(t)  is  Independent 
of  X(0)  and  that  5  is  a  Brovnlan  notion  with  drift  p,  covariance 
matrix  A  and  g(0)  =  0.  Observe  that  N(X,t)  ■  N(£,t). 

Corollary  4.95  Implies  that 


X 

(63)  8*01(01)  <  K*(H(5,t))  •  4M(  v  b  )  , 

n-1 

where  N(£,t)  Is  defined  by  (4.49),  and  M  Is  the  number  of  stages. 
Elementary  properties  of  Brownian  motion  Imply  that  E^(N(g,t))  <  <*>. 
Since  Z  is  Independent  of  X(0)  it  follows  that 

(64)  E*(N(5,t))  -  E°(N(5,t))  <  -  . 

Lines  (63)  and  (64)  together  imply  (62). 

(65)  Corollary.  Every  k  e  (1,  2,  ...,  K+l)  satisfies 

(66)  E*(Yk(t))  <  •  for  t  >  0  . 
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The  proof  of  (66)  is  a  direct  conaequence  of  (62). 

Let  k  c  {1,  2,  ...»  K+l)  end  t  >  0  be  given.  For  f  e  C(S) 
define  X^(f )  as  follows: 

t 

(67)  Xt(f)  =  E*[J  f(Z(s))  dYk(e)]  . 

(68)  Proposition.  The  operator  Xt  is  bounded,  linear  and 
positive. 

Proof .  The  linearity  and  positivity  of  Xt  follows  easily  froa  the 
linearity  and  poaitlvlty  of  E*.  If  If  |  £  1  then 

t 

(69)  |Xt(f)|  <  B*[f  If I  dYk(s)]  <  K*  Yk(t)  <  at  .  Q.K.D. 

(70)  Corollary.  The  operator  Xt  has  the  following  representa¬ 
tion: 

(71)  \J f)  -  /  f(x)  X<dx)  , 

S  z 

A 

where  Xfc  is  a  finite  measure  on  the  Borel  sets  of  S. 

Proof.  Observe  that  S  is  a  compact  Bausdorff  space,  and  that  Xt 
is  a  bounded  linear  functional  on  C(S).  Therefore  the  Rlesz 
Representation  Theorem  (see  Royden  [12])  implies  that  there  exists  a 
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poat-t  field.  The  penult  lute  equality  follows  from  the  statlooarlty 
of  the  Z  process  and  (4.9).  Q.E.D. 

(74)  Proposition.  Every  t  >  0  and  f  e  C(S)  together  satisfy 

t 

(75)  Xt(f)  S  E*[J  f(Z(s))  dYk(s)]  -  t  /  f(x)  ^(dx)  . 

0  S 

Proof.  Let  f  e  C(S)  be  given.  The  function  g(t)  =  Xt(f)  Is 
linear  and  continuous,  therefore  elementary  function  theory  Implies 
that 

(76)  \t(f)  -  g(t)  -  tg(l)  -  tXj(f)  -  t  /  f(x)  Xj(dx)  . 

Finally,  vfc  equals  Xi  by  definition.  Consequently  (75)  must 
hold. 

(77)  Proposition.  The  measure  vfc  is  supported  by  S^. 

Proof.  Observe  that  lines  (4.5)-(4.7)  Imply  that 

(78)  Ig  -  I  a.s.  Yk(w)  for  every  to  e  Q  . 

Therefore, 

1  1 

(79)  E*  /  I  (Z(t))  dY.(t)  -  E*  /  I.(Z(t))  dY.(t)  , 

0  Tc  *  05  * 


90 


finite  signed  aeasure  Xt  which  satisfies  (71).  Since  Xt  is  a 

A 

positive  operator,  it  follows  that  Xt  aust  be  a  positive  aeasure. 

Q.E.D. 

In  the  following  we  will  let  the  synbol  Xt  represent  both  the 

A 

operator  Xt  and  the  aeasure  Xf 

(72)  Proposition.  Every  t.s  >  0  and  f  e  C(S)  satisfy 

(73)  X,.(f)  "  Mf>  +  ^  <f>  • 

UTB  C  S 

Proof. 

t+s 

Xt+8(f)  5  E*[/  f(Z(u))  dYk(u)] 

t  t+s 

-  E*[/  f (Z(u))  dY.(u)]  +  E*[J  f(Z(u))  dY.  (u)] 

0  K  t 

-  X  (f)  +  E*(EZ(t)[/t  8  f (Z(u))  dY.  (u)]) 

t 

-  X„(f)  +  E*[/8  f (Z(u))  dY.  (u) ] 

C  0  * 

-  xt(f)  +  Xg(f)  . 

The  antepenultlaate  equality  follows  froa  the  Markov  property  of  the 
(Z,Y)  process  and  the  fact  that  / f(Z(u))  dY^(u)  belongs  to  the 
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where  each  Integral  la  defined  pathvlse  as  a  Lebesgue-Stieltjes 
Integral.  Line  (79)  now  1 spiles  that  vk(Sk)  -  \(Sk>  ■  E*(Yk(l)). 

Q.E.D. 


We  will  now  prove  Theorea  59.  Take  f  c  S  then  Theorea  41 
lap lies  that 


f  K  t  - 

(80)  f(Z(t))-f(Z(0))  -  /  Lf (Z(s) )ds  +  l  /  (Z(s))  dH.(s) 

0  WO  "k  * 


K+l  t 

+ If  a  f(z(a))  dY.(s)  . 
k-1  0 


Apply  E*  to  (80),  and  use  the  atatlonarlty  of  Z  and  Fublnl's 
Theorea  to  obtain 


K+l  t 

(81)  0  -  t  /  Lf (x)  n(dx)  +  l  E*[/  D  f(Z(s))  dY  (s)]  . 

S  k-1  0  * 


Apply  Propositions  74  and  77  to  (81)  to  obtain 


K+l 

(82)  0  -  t  /  Lf (x)  II(dx)  +  l  t  /  D.f(x)  v.  (dx)  . 

S  k-1  Sk 


Dividing  through  by  t  we  now  obtain  (60). 


CHAPTER  6 


A  LIMIT  THEOREM 


In  this  chapter  we  consider  a  sequence  of  production  networks 
indexed  by  n  -  1,  2,  ...  .  (Processes  and  quantities  associated  with 
the  nth  system  will  be  indicated  by  a  superscript  n.)  Each  system  in 

the  sequence  has  the  same  number  of  work  stations,  denoted  by  K+l  as 

in  Chapters  3  and  4,  and  has  the  same  network  structure,  embodied  in  a 
fixed  successor  mapping  a  as  in  Chapters  3  and  4.  The  sizes  of  the 
storage  buffers  and  the  stochastic  character  of  the  various  potential 
output  processes  will  be  allowed  to  depend  on  n.  Specifically,  it 
will  be  assumed  that  storage  buffer  k  is  of  size  b^  nl/2  in 
the  nth  system,  where  b  “  (bj,  bg)  is  a  fixed  vector  with 

strictly  positive  components. 

6.1  The  Main  Result 

Let  (4>,4)  be  the  reflection  mapping  on  CK  defined  in  terms 
of  a  as  in  Chapter  4.  Recall  that  we  write  4tCx.b)  and  $(x,b) 
when  it  is  desirable  to  indicate  explicitly  the  dependence  of  these 

maps  on  the  capacity  levels  b  -  (blt  ...,  b^) . 

Let  (Q,11,P)  be  a  probability  space  upon  which  there  are  defined 
a  sequence  of  potential  output  processes  n  _>  1}.  Define 

{X(n),n>l>  by 

(1)  x£n>  =  for  k  -  1 . K  . 

Alternately,  we  can  represent  x(Q)  by 
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(2) 


!<”>  5  F5<“> 


where  F  is  a  K  x  K+l  matrix  defined  by 


(  ‘ 

for  j  -  i 

(3) 

H 

1 

III 

for  j  -  o(i)  . 

l  0 

otherwise 

Define 

(z(n),  Y(n))  for  n  >  1 

as  follows: 

(4)  2<n)(t)  =  n"1/2  ♦<X(n),  n1/2  b)  (nt)  , 
and 

(5)  Y(n)(t)  s  n”1/2  <J»(X(n) ,  n1/2  b)  (nt)  . 


Referring  to  Chapters  3  and  4,  we  see  that  $(X^n\  n1^2  b)  is  the 
K-dlmen8lonal  buffer  contents  process  for  a  production  network  with 
potential  output  process  and  capacity  n^2b.  That  is, 

$(X^ ,  n^  b)  is  the  contents  process  for  our  nth  system,  and 
4»(X^n\  n ' '  z  b)  is  the  associated  loot  potential  output  process. 
Then  Z^  and  Y^  are  obtained  from  these,  the  processes  of 
fundamental  interest,  by  a  rescaling  of  time  and  space. 


(6)  Theorem. 


Let  X^n\  Z^,  Y^n^  be  defined  by  (1),  (4),  (5) 


respectively.  Suppose  that 
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(7)  n“1/2  X<n)(nt)  — >  X  as  n  , 

where  X  Is  a  Brownian  wocion  with  drift  vector  p  and  covariance 
matrix  A  as  In  Chapter  5.  Then 

(8)  (Z(n\  Y<n))  ->  (♦(X,b),  4»(X,b))  as  n  . 

Proof.  Leans  4.75  Implies  that 

(9)  Z(n)(t)  -  d(n"1/2  X(n)(nt),  b)  , 
and 

(10)  Y(n)(t)  -  *(n’1/2  X(n)(nt),  b)  . 

Theorem  4.69  Implies  that  the  mapping  z  ♦  (+(x)v  4i(z))  is  continuous 
from  C*  to  c2™.  Since  n”1^2  X^(n»)  converges  weakly  to  X, 
the  continuous  mapping  theorem  implies  that 

(11)  (6(n"1/2  X<B)(nt),  b),  6(n”1/2  X<n)(nt),  b) 

->  (♦(X,b)>  <KX,b))  as  n  ♦  •  . 
Lines  (9),  (10)  and  (11)  jointly  imply  (8).  Q.K.D. 

6.2  TWo  Applications 

As  specific  ezamples  of  our  general  production  network,  we 
discussed  in  Chepter  3  a  random  walk  model  and  a  random  environment 
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model.  Thtorn  12  below  shows  how  the  hypothesis  of  our  male  result 
(6)  can  be  satisfied  by  s  sequence  of  random  walk  nodels.  The 
interpretation  of  this  result  in  teres  of  randoe  walk  models  will  be 
clear  from  the  notational  parallels  with  Section  3.2. 

(12)  Theorem.  Let  (Q.B^P)  be  a  probability  space  and  suppose  that 

for  each  n  ^  1  there  exists  (■);  •  _>  1}  a  sequence  of  IID 

randoe  K+l  vectors  such  that 

(13)  lim  n*^2  E(FC^(1))  ■  p  ,  where  p  e  k*  , 

n  •+•  • 

(14)  lie  Cov(C(  )(l»  -  0  ,  where  D  Is  a  K+l  *  K+l 

n  ♦  •  positive  definite  matrix, 

and 

(15)  11a  /  IC(n>l2  dP-0  for  all  e>0. 

n  *  *  {IC<n)(l)«>en1/2> 

Define  C<“>(t)  as  follows 

(16)  e(n)(t)  s  C<n)(a)  +  (t-It|)  C<n)(lt+1]>  . 

Define  it11)  by 

d7)  x(n)  s  n<B)  • 

Let  X  be  a  K-dlmenslonal  Brownian  motion  starting  at  0  with  drift 
p  and  covariance  matrix  A  ■  PDF’ .  Finally  define  (Z^,  Y^)  by 
equations  (4)  and  (5).  Then 
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(18) 


aa  n  ♦  • 


(2(“\  T(  ))  ->  (♦(X.b),  4>(X,b)) 

Proof*  Leans  20  (proved  below)  laplles  that 

(19)  11a  n“1/2  X(n)(n«)  — >  X  . 

n  ♦  » 

Lina  (19)  and  Theorem  6  jointly  iaply  (18). 

(20)  Lana.  Let  (Q,B,P)  be  a  probability  apace  and  euppoee  that  for 
each  n  £  1  there  exists  {tj(n)(a)j  ■_>  1}  a  sequence  of  IID 

r endow  K-vectors  auch  that 

(21)  11a  J  lt|(n)(l)l2  dP  -  0  ,  for  all  c  >  0, 

m  *  *  <lT,<n)(l).>en1/2> 

(22)  11a  CovO|(n)(l)  -  k  , 

n  ♦  • 

and 

(23)  11a  n1/2  Mnfn\  1)  -  p  . 

n  ♦  • 

Define  X<*0  for  n  >  1  by 

(24)  x<B)  -  {f  Ti<n)(j)  +  (t  -  [tj)  n<tt)aw-U)  . 

3-1 

Then  n  1/2  X^“\n*)  converges  weekly  to  X  as  n  ♦  •,  where  X  is 
a  Brownian  notion  with  drift  vector  p  and  covariance  matrix  k. 
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Proof*  Lomu  2*104  implies  that  it  it  sufficient  to  prove  that 
{r,j(X^),  n>  1}  converges  weakly  to  r^fr)  for  every  T  >  0  (eee 
(2.103)  for  the  definition  of  r^).  The  weak  convergence  of 
{rT(X^),  n  >.  1}  to  rT(X)  can  be  proved  by  Imitating  the  proof  of 
Theorem  4.1  of  Parthasarathy  [11J.  Q.E.D. 

Finally*  we  consider  a  sequence  of  random  environment  aodele 
which  eatlsfy  the  hypothesis  of  our  limit  theorem  (6).  Tor 
simplicity*  we  suppose  that  the  various  systems  in  this  sequence  share 
a  common  environment  process  6*  but  the  work  rates  r^Cm)  for 
various  states  of  the  environment  m  change  with  sequence  index  n* 
The  interpretation  of  the  following  in  terns  of  random  environment 
models  will  be  clear  from  the  notatlonal  parallels  with  Section  3.3. 

(23)  Theorem.  Let  (Q*B,P)  be  a  probability  space  and  suppose  that 
there  la  defined  on  (Q*JB*P)  an  ergodic  Markov  chain  0  =  {0(0 , 
t J>  0)  with  state  space  (1*  2*  ...  *  M)  and  stationary  distribution 
n.  For  n  >  1,  let  r(°)  be  a  mapping  from  {1,  2*  ...,  M)  to 
b£+1.  Suppose  that  0  and  r^  jointly  satisfy 

(26)  0(0)  -  n  , 

(27)  E{Fr^(0(O))J  n1^2  ♦  p  as  n  ♦  •*  where  p  e  1*  , 
and 

(28)  11a  fr^  ■  g  *  where  Igl  <  •  • 


Define  w(n)  end  X^  respectively  by 

(29)  w(n)(s)  -  Pr(n)(0(n)(a))  , 

end 

(30)  X^°^(t)  •  /  w^(e)  de  t  for  t  >  0  end  n  >  1  . 

0 

de  before  define  (Z^n\  T^)  by  equetlone  (4)  end  (5).  Then 
(Z(n\  Y^)  converged  weekly  to  (+(X,b),  ^X,b)),  where  X  le  e 
Brownlen  notion  storting  et  0  with  drift  |i  end  coverlence  aetrlz 
A  defined  by 

m 

(31)  A  i  2  /  Cov(g(0(O))f  g( 0(e)))  de  . 

0 

Before  we  cen  begin  the  proof  of  Theoren  25,  we  need  to  consider 
sone  p-ellulnary  concepts. 

Let  v"  (v(t)  t  t  >  0)  be  s  etocheetlc  proceed  fron  0  to 
fie  define  v  to  be  h-wlnlng  If 

(32)  jp(Xl  n  X2)  -  P(Xl).P(I2)|  <  Fdj)  h(t)  , 

holds  whenever  Ij  Use  la  the  o-fleld  genereted  by  (v(e); 

0  <  n  <  e)  end  I2  lies  la  the  o-fleld  generated  by  (v(n)  j 
a  >  e+t) . 

(33)  Unas.  Suppose  <v<®),  a  >  1)  Is  e  sequence  of  strictly 
stationery  stochastic  processes  on  (Q,B,P)  which  jointly  satisfy 


98 


(34) 


05) 

(36) 

(37) 

(38) 

«)i>rt 

(39) 

Define 

(40) 

Than  t 
notion 


vj  is  a  Muunbli  function  i.i.  P, 


(n) 


Inch  process  v  is  b-nlzlnf , 


/  h1/2(t)  dt  <  • 


lv£n)  I  dP 
(lv<n)«>e  n1/2> 


11.  / 


■  0  for  oil  c  >  0 


1*  Cov(vin) ,  v<n))  -  p(s), 

n  ♦  •  ° 


p  Is  s  ronl  valued  aatrlx  function,  and 


Urn  n1/2  Xv*n)  -  |i  c  IK 
n  ♦  • 


i<“)  . 


elemut  of  C*  by 


X*“*(t)  s  /  T^n;  da  . 

0  ■ 


.(*> 


-1/2 


i  X„(n»)  convergea  weakly  to  X,  where  X  la  a  Brown!* 
with  drift  |i  and  covariance  net r lx  A  •  (a*j)  by 


<♦» 


•ij  *  J  £  piju)  *  • 

The  proof  of  T  saws  33  Is  alaost  Identical  to  that  of  Theorsa  20.: 
of  Billingsley  [1],  and  therefore  we  oalt  it.  Q.B.D. 

He  will  now  prove  Theorsa  25.  Since  6  is  an  ergodic  Markov 
chain,  it  la  possible  to  show  that  there  exists  h(t)  3  ar*  (where 
a  >  0  and  r  <  1)  such  thst  8  Is  h-alxing.  Consequently  w^ 
suet  also  be  h-nlxing.  Clearly  h  satisfies  condition  (36)  of 
lean  33.  Observe  that  sup^j  llr^l  <  •  and  therefore  w^ 
eatiefles  (27).  Line  (28)  guarantees  that 

(42)  11a  Cov(w<n)(0),  w(,l)(e))  -  Cov(g(e(0))f  g(8(e)))  . 
n  ♦  • 

finally  observe  that  w^  la  aeesurable  alaost  surely  (?)  because 
0  Is  aeesurable  alaost  surely  (P).  Therefore  n  >_  1)  satis** 

flee  the  hypotheses  of  Leans  33  and  thus 

(43)  11a  n"l/2  X<B>(nO  ->  X  , 

a  ♦  • 

where  X  la  a  Brownian  notion  starting  at  0  with  drift  p  aad 
covariance  A.  Theorea  6  now  laplles  the  desired  result. 

(44)  Baaark.  Condition  26  nay  be  oaitted  froa  Theorea  25  without 
changing  its  conclusions. 
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